-- Logs begin at Sat 2022-06-04 17:42:34 UTC, end at Sat 2022-06-04 18:51:51 UTC. -- Jun 04 18:20:04.669233 dv-cinder-790535-41-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 04 18:20:04.676637 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 18:20:04 2022] *** Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: nodename: dv-cinder-790535-41-iscsi Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: machine: x86_64 Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: clock source: unix Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: pcre jit disabled Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: detected number of CPU cores: 4 Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: current working directory: / Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: detected binary path: /usr/bin/uwsgi-core Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: your processes number limit is 47680 Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: your memory page size is 4096 bytes Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: detected max file descriptor number: 2048 Jun 04 18:20:04.679034 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: lock engine: pthread robust mutexes Jun 04 18:20:04.679891 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: thunder lock: enabled Jun 04 18:20:04.679891 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 04 18:20:04.679891 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 18:20:04.723359 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: Python main interpreter initialized at 0x5590ddd009c0 Jun 04 18:20:04.723359 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: python threads support enabled Jun 04 18:20:04.723359 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: your server socket listen backlog is limited to 100 connections Jun 04 18:20:04.723359 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: your mercy for graceful operations on workers is 90 seconds Jun 04 18:20:04.723731 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 18:20:04.723731 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: *** Operational MODE: preforking *** Jun 04 18:20:04.724045 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: *** uWSGI is running in multiple interpreter mode *** Jun 04 18:20:04.724045 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: spawned uWSGI master process (pid: 103127) Jun 04 18:20:04.724238 dv-cinder-790535-41-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 04 18:20:04.724801 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: spawned uWSGI worker 1 (pid: 103128, cores: 1) Jun 04 18:20:04.725150 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: spawned uWSGI worker 2 (pid: 103129, cores: 1) Jun 04 18:20:04.725307 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 18:20:05.924027 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 18:20:05.924751 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 18:20:06.631041 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:20:06.631041 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: from cryptography.utils import int_from_bytes Jun 04 18:20:06.631305 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:20:06.631305 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: from cryptography.utils import int_from_bytes Jun 04 18:20:06.631420 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:20:06.631420 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: from cryptography.utils import int_from_bytes Jun 04 18:20:06.631551 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:20:06.631551 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: from cryptography.utils import int_from_bytes Jun 04 18:20:09.160219 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 18:20:09.160819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 18:20:09.160963 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 18:20:09.161327 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 18:20:09.161577 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 18:20:09.161954 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.162277 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.162587 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.162900 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.163221 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.163532 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.163846 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.164163 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.164829 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.165079 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.165388 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.165706 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-41-iscsi {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.166020 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.166323 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.166623 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.166720 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 18:20:09.167080 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 18:20:09.167230 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.167230 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.167494 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 18:20:09.167624 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.167760 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 18:20:09.167884 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.168099 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 18:20:09.168406 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.168863 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.168863 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.169085 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.169188 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.169296 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.169409 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.169522 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.169702 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.169888 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.170047 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.170257 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.170448 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.170650 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.170834 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.171024 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.171178 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.171390 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.171390 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.171720 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.171898 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.172080 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.172299 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-41-iscsi {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.172486 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-41-iscsi {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.172644 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.172818 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.172994 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.173209 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.173401 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.173596 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.173744 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.173956 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.174152 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.174300 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.174494 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.174654 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.174785 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.174949 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.174949 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.175214 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.175366 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.175496 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.175496 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.175744 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.175865 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.176040 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.176040 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.176296 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.176416 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.176543 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.176678 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.176811 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.176939 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.177070 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.177192 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.177346 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.177470 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.177591 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.177718 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.177841 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.177971 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.178093 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-41-iscsi {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.178222 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.178345 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.178564 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.178697 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.178829 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.178952 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.179073 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.179073 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.179315 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.179437 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.179600 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.179731 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.179862 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.180066 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.180195 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.180316 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.180576 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.180705 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.180829 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.180960 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.181095 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.181227 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.181349 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.181476 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.181599 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.181730 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.181852 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.181984 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.182106 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.182233 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.182368 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.182490 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.182611 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.182747 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.182934 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.183067 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.183211 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.183345 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.183518 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.183647 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.183884 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.184056 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.184293 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.184432 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.184554 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.184676 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.184806 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.184937 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.185145 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.185283 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.185462 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.185601 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.185730 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.185865 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.185987 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.186111 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.186320 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.186450 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.186628 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.186846 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.186971 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.187098 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.187227 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.187349 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.187488 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.187617 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.187805 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.187933 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.188127 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.188259 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.188394 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.188535 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.188706 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.188831 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.188964 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.189098 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.189232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.189356 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.189515 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.189644 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.189826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.189955 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.190120 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.190249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.190423 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.190580 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.190770 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.190904 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.191035 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.191168 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.191297 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.191428 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.191583 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.191761 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.191890 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.192093 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.192223 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.192413 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.192561 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.192723 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.192860 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.193038 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.193165 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.193341 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.193468 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.193633 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.193770 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.193945 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.194072 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.194241 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.194369 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.194529 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.194659 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.194790 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.194911 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.195083 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.195218 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.195354 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.195483 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.195686 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.195822 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.195974 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.196257 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.196395 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.196517 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.196639 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.196764 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.196885 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.197018 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.197167 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.197299 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.197469 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.197593 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.197770 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.197911 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.198064 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.198196 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.198362 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.198486 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.198662 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.198794 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.198962 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.199087 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.199272 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.199459 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.199605 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.199869 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.199999 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.200148 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.200261 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.200381 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.200547 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.200675 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.200878 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.201009 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.201131 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.201261 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.201394 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.201526 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.201710 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.201846 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.202025 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.202151 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.202325 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.202449 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.202625 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.202769 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.202924 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.203058 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.203222 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.203347 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.203537 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.203670 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.203843 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.203963 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.204174 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.204301 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.204490 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.204615 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.204787 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.204927 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.205090 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.205301 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.205436 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.205653 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.205778 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.205965 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.206093 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.206466 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.206600 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.206874 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.207055 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.207219 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.207367 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.207525 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.207684 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.207854 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.208064 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.208224 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.208365 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.208504 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.208643 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.208810 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.208965 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.209110 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.209258 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.209399 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.209537 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.209676 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.209830 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.209976 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.210124 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.210264 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:20:09.210407 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.210546 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.210706 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.210847 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.211082 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.211225 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.211376 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.211515 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.211670 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.211836 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.211991 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.212169 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.212312 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.212455 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.212622 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.212788 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.212962 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.213119 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.213270 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.213420 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.213578 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.213721 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.213862 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.214015 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.214182 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.214340 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.214487 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.214632 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.214776 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.214969 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.215154 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.215313 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.215459 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.215606 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.215749 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.215894 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.216065 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.216224 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.216368 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.216509 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.216651 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.216799 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.216944 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.217095 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.217249 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.217398 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.217540 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.217690 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.217845 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.218018 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.218160 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.218302 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.218450 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.218591 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.218751 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.218929 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.219081 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.219081 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.219368 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.219521 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.219676 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.219827 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.219972 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.220153 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.220304 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.220452 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.220605 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.220751 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.220903 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.221059 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.221263 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.221414 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.221566 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.221707 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.221847 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.221987 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.222134 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.222283 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.222432 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.222571 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.222716 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.222857 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.222998 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.223152 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.223293 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.223432 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.223571 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.223711 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.223850 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.224000 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.224196 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.224370 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.224514 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.224663 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.224806 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.224954 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.225098 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.225239 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.225381 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.225524 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.225678 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.225821 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.225963 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.226119 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.226272 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.226420 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.226574 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.226723 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.226868 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.227008 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.227151 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.227293 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.227442 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.227590 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.227733 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.227883 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.228111 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.228269 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.228423 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.228564 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.228705 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.228844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.228999 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.229168 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.229309 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.229448 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.229586 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.229725 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.229864 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.230010 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.230151 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.230297 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.230451 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.230629 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.230771 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.230925 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.231066 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.231204 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.231423 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.231423 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.231702 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.231856 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.231997 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.232175 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.232320 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.232462 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.232616 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.232768 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.232910 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.233051 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.233191 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.233332 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.233483 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.233625 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.233765 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.233913 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.234066 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.234210 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.234391 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.234538 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.234683 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.234828 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.234972 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.235116 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.235306 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.235460 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.235605 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.235798 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.235945 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.236172 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.236316 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.236465 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.236606 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.236746 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.236898 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.237047 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.237188 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.237328 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.237467 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.237607 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.237753 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.237903 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.238048 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.238214 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.238357 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.238505 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.238684 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.238834 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.238977 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.239181 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.239326 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.239466 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.239606 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.239755 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.239903 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.240078 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.240228 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.240386 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.240544 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.240691 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.240843 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.240995 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.241138 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.241282 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.241449 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.241666 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.241814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.241971 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.242117 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.242262 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.242489 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.242635 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.242783 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.242928 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.243073 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.243224 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.243378 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.243522 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.243666 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.243811 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.243962 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.244156 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.244306 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.244473 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.244632 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.244773 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.244913 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.245064 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.245205 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.245343 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.245482 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.245621 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.245760 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.245919 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.246061 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.246261 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.246413 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.246562 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.246703 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.246857 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.247004 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.247145 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.247284 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.247430 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.247578 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.247717 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.247863 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.248049 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.248197 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.248362 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.248521 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.248670 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.248818 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.248960 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.249103 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.249268 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.249438 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.249586 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.249730 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.249881 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.250028 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.250174 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.250326 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.250472 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.250626 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.250772 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.250915 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.251070 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.251225 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.251371 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.251515 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.251681 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.251891 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.252100 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.252254 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.252404 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.252546 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.252686 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.252833 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.252982 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.253123 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.253271 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.253411 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.253561 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.253707 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.253856 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.254005 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.254145 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.254285 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.254425 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.254595 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.254765 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.254905 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.255051 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.255203 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.255344 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.255495 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.255641 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.255788 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.255928 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.256093 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.256236 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.256391 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.256546 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.256687 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.256828 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.256980 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.257127 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.257277 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.257419 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.257567 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.257709 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.257856 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.257998 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.258146 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.258288 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.258458 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.258608 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.258749 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.258904 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.259054 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.259203 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.259358 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.259530 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.259678 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.259837 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.259983 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.260183 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.260323 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.260463 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.260615 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.260769 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.260919 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.261073 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.261228 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.261373 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.261513 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.261663 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.261837 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.262128 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.262270 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.262410 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.262572 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.262755 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.262897 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.263046 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.263186 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.263334 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.263558 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.263709 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.263709 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.263977 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.264166 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.264166 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.264452 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.264601 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.264779 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.264930 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.265082 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.265225 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.265376 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.265547 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.265704 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.265850 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.265994 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.266147 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.266294 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.266439 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.266583 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.266726 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.266874 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.267041 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.267195 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.267359 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.267504 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.267648 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.267792 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.267936 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.268117 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.268261 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.268408 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.268568 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.268719 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.268859 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.269016 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.269157 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.269303 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.269452 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.269621 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.269769 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.269918 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.269918 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.270187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.270328 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.270468 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.270609 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.270757 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.270907 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.271046 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.271192 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.271341 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.271496 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.271636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.271776 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.271916 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.272103 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.272315 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.272470 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.272613 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.272764 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.272914 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.273055 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.273212 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.273355 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.273524 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.273730 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.273883 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.274025 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.274166 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.274317 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.274475 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.274616 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.274770 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.274946 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.275102 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.275249 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.275404 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.275550 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.275696 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.275840 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.275985 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.276196 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.276341 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.276480 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.276628 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.276769 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.276912 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.277066 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.277215 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.277355 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.277606 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.277771 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.277912 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.278064 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.278216 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.278357 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.278506 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.278663 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.278822 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.278973 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.279119 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.279267 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.279415 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.279560 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.279778 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.279928 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.280104 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.280251 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.280396 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.280553 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.280707 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.280852 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.280852 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.281143 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.281289 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.281441 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.281596 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.281741 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.281884 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.282029 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.282173 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.282330 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.282553 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.282703 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.282848 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.282999 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.283152 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.283306 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.283457 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.283609 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.283755 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.283899 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.284108 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.284267 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.284407 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.284546 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.284685 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.284826 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.284982 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.285149 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.285290 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.285431 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.285570 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.285709 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.285850 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.285998 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.286139 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.286289 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.286430 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.286569 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.286792 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.286946 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.287087 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.287226 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.287365 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.287505 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.287654 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.287795 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.287935 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.288101 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.288246 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.288398 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.288550 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.288692 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.288877 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.289022 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.289163 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.289306 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.289808 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.289979 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.290125 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.290270 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.290413 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.290570 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.290716 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.290861 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.291005 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.291157 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.291303 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.291458 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.291628 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.291774 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.291930 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.292114 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.292291 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.292453 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.292719 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.292857 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.292985 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.293144 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.293280 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.293427 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.293563 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.293709 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.293847 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.293988 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.294144 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.294309 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.294463 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.294625 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.294770 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.294913 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.295069 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.295215 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.295364 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.295507 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.295650 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.295790 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.295948 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.296150 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.296321 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.296468 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.296635 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.296790 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.296974 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.297141 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.297304 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.297483 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.297642 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.297818 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.297983 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.298147 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.298311 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.298477 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.298655 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.298834 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.299001 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.299178 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.299346 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.299513 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.299692 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.299882 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.300107 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.300269 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.300440 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.300595 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.300740 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.300914 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.301052 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.301180 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.301313 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.301458 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.301609 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.301747 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.301882 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.302021 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.302169 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.302322 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.302488 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.302638 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.302904 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.303052 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.303195 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.303351 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.303503 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.303646 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.303791 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.303937 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.304105 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.304287 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.304462 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.304632 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.304798 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.304961 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.305125 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.305316 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.305503 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.305665 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.305832 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.305995 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.306170 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.306348 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.306525 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.306693 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.306861 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.307045 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.307223 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.307402 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.307580 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.307755 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.308768 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.308901 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.309043 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.309174 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.309298 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.309417 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.309536 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.309656 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.309784 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.309905 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.310024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.310142 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.310266 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.310395 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.310522 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.310648 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.310767 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.310887 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.311005 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.311133 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.311251 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.311369 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.311488 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.311606 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.311724 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.311859 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.311989 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.312197 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.312317 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.312435 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.312554 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.312687 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.312806 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.312943 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.313220 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.313341 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.313474 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.313605 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.313723 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.313850 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.313969 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.314097 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.314223 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.314341 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.314467 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.314596 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.314714 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.314831 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.314831 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.315065 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.315190 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.315317 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.315445 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.315563 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.315563 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.315859 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.315978 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.316118 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.316251 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.316380 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.316499 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.316619 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.316737 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.316860 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.316985 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.317113 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.317232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.317351 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.317479 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.317645 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.317765 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.317901 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.318029 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.318156 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.318274 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.318398 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.318581 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.318755 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.318901 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.319050 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.319191 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.319358 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.319508 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.319648 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.319787 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.319937 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.320095 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.320243 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.320385 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.320525 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.320681 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.320831 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.320970 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.321109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.321250 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.321389 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.321538 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.321687 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.321832 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.321971 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.322115 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.322255 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.322404 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.322545 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.322696 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.322839 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.322979 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.323134 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.323350 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.323500 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.323642 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.323780 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.323920 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.324132 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.324295 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.324439 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.324595 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.324738 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.324886 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.325106 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.325248 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.325392 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.325533 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.325677 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.325825 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.325825 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.326123 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.326266 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.326408 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.326408 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.326686 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.326836 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.326995 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.327139 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.327279 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.327427 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.327577 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.327720 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.327868 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.328039 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.328193 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.328335 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.328488 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.328653 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.328835 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.328997 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.329140 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.329284 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.329439 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.329584 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.329729 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.329882 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.330040 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.330185 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.330337 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.330481 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.330625 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.330777 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.330922 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.331075 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.331218 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.331362 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.331505 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.331655 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.331799 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.331955 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.332123 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.332268 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.332411 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.332555 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.332710 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.332864 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.333018 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.333163 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.333321 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.333528 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.333681 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.333841 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.333987 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.334139 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.334284 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.334429 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.334581 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.334725 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.334868 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.335021 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.335172 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.335324 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.335479 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.335629 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.335780 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.335924 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.336096 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.336096 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.336378 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.336520 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.336662 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.336804 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.336948 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.337089 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.337244 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.337385 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.337540 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.337688 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.337830 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.337982 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.338124 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.338265 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.338406 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.338547 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.338712 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.338898 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.339076 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.339076 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.339372 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.339519 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.339662 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.339815 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.340058 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.340228 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.340432 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.340662 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.340812 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.340978 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.341129 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.341274 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.341429 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.341580 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.341734 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.341878 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.342029 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.342175 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.342318 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.342463 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.342621 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.342773 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.342773 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.343049 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.343049 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.343333 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.343333 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.343704 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.343704 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.343981 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.344178 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.344333 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.344486 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.344632 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.344783 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.344937 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.345088 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.345242 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.345406 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.345560 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.345706 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.345850 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.346000 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.346163 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.346310 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.346460 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.346612 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.346757 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.346900 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.347055 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.347200 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.347359 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.347511 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.347672 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.347829 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.348036 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.348209 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.348367 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.348531 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.348701 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.348701 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.349029 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.349029 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.349370 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.349560 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.349560 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.349918 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.350094 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.350270 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.350463 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.350640 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.350820 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.350975 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.351138 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.351309 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.351489 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.351683 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.351898 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.352204 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.352420 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.352635 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.352846 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.353051 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.353243 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.353423 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.353600 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.353890 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.354047 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.354309 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.354469 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.354641 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.354803 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.354967 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.355138 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.355311 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.355461 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.355639 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.355834 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.355982 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.356167 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.356325 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.356475 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.356624 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.356768 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.356908 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.357059 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.357209 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.357349 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.357489 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.357627 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.357767 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.357915 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.358061 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.358202 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.358341 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.358480 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.358628 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.358775 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.358775 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.359042 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.359182 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.359329 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.359477 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.359619 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.359765 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.359905 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.360090 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.360237 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.360387 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.360529 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.360670 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.360820 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.360961 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.361104 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.361280 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.361464 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.361637 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.361791 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.362008 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.362181 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.362336 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.362481 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.362627 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.362772 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.362917 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.363070 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.363215 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.363360 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.363512 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.363512 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.363806 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.364112 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.364258 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.364400 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.364540 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.364680 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.364820 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.364966 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.365125 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.365316 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.365461 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.365618 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.365772 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.365920 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.366060 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.366201 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.366341 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.366482 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.366633 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.366773 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.366913 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.367057 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.367198 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.367345 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.367496 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.367643 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.367784 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.367924 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.368096 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.368241 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.368241 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.368539 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.368683 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.368825 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.368967 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.369121 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.369263 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.369412 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.369566 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.369710 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.369855 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.370008 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.370150 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.370291 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.370432 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.370432 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.370701 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.370852 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.370993 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.371205 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.371352 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.371352 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.371657 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.371823 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.371969 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.372139 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.372292 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.372434 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.372582 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.372723 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.372874 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.373022 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.373169 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.373315 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.373464 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.373604 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.373762 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.373968 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.374191 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.374191 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.374481 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.374628 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.374768 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.374768 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.375034 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.375174 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.375359 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.375503 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.375650 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.375793 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.375938 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.376117 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.376268 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.376411 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.376558 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.376701 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.376843 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.377002 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.377147 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.377301 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.377444 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.377597 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.377739 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.377889 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.378033 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.378176 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.378317 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.378468 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.378619 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.378768 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.378909 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.379056 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.379198 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.379346 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.379495 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.379637 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.379821 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.379968 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.380167 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.380310 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.380466 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.380607 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.380747 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.380901 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.381052 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.381195 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.381344 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.381493 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.381633 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.381818 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.381990 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.382215 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.382359 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.382359 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.382624 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.382763 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.382907 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.383056 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.383204 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.383345 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.383493 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.383634 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.383773 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.383923 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.384104 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.384325 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.384469 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.384618 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.384759 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.384915 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.385060 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.385210 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.385367 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.385538 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.385693 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.385839 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.385983 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.386126 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.386270 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.386413 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.386566 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.386724 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.386917 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.387076 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.387221 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.387365 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.387519 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.387663 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.387808 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.387959 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.388141 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.388279 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.388401 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.388523 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.388643 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.388774 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.388894 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.389025 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.389152 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.389289 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.389410 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.389539 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.389658 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.389786 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.389903 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.390033 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.390151 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.390285 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.390422 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.390540 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.390659 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.390780 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.390899 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.391019 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.391150 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.391270 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.391390 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.391516 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.391635 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.391789 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.391955 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.392240 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.392361 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.392483 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.392602 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.392735 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.392735 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.392966 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.393085 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.393202 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.393319 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.393451 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.393579 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.393699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.393818 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.393936 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394062 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394191 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394308 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394430 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394506 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394571 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394637 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394711 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394778 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394850 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394916 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.394980 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395052 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395118 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395182 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395246 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395310 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395375 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395476 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395549 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395614 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395686 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395752 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395822 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395905 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.395972 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.396060 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.396244 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.396319 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.396552 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.396652 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.396863 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.396955 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.397167 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.397257 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.397475 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.397566 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.397778 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.397868 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.398081 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.398171 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.398384 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.398468 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.398685 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.398770 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.398989 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.399072 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.399292 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.399376 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.399598 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.399681 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.399898 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.399991 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.400225 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.400309 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.400527 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.400621 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.400827 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.400920 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.401133 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.401217 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.401435 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.401519 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.401739 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.401838 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.402038 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.402121 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.402340 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.402472 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.402684 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.402778 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.403025 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.403142 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.403328 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.403481 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.403636 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.403798 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.403943 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.404145 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.404298 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.404458 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.404601 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.404778 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.404923 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.405086 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.405220 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.405406 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.405552 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.405726 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.405825 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.406040 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.406143 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.406349 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.406445 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.406677 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.406772 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.406991 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.407096 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.407303 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.407405 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.407615 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.407700 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.407926 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.408041 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.408260 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.408355 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.408566 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.408652 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.408840 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 18:20:09.408933 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.409199 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.409505 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.409828 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.410143 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.410511 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.410775 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.411082 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.411408 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.411720 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.412049 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.412372 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.412684 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.412993 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.413307 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.413623 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.413947 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.414271 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.414927 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.415250 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.415575 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.415921 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.416271 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.416615 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.416949 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.417264 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.417575 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.417880 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:20:09.418244 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 18:20:09.466209 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO dbcounter [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Registered counter for database nova_api Jun 04 18:20:09.475275 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO dbcounter [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Registered counter for database nova_api Jun 04 18:20:09.486206 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_db.sqlalchemy.engines [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:20:09.492960 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writer thread running {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:20:09.495284 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:20:09.501984 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writer thread running {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:20:09.550027 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.context [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),06ed45c9-c444-4a55-b87d-b6450438916e(cell1) {{(pid=103128) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 18:20:09.554222 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:20:09.555779 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:20:09.556583 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:20:09.558095 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.context [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),06ed45c9-c444-4a55-b87d-b6450438916e(cell1) {{(pid=103129) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 18:20:09.558525 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:20:09.560735 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO dbcounter [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Registered counter for database nova_cell0 Jun 04 18:20:09.562233 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:20:09.563807 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:20:09.564612 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:20:09.564744 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO dbcounter [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Registered counter for database nova_cell1 Jun 04 18:20:09.566612 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG oslo_concurrency.lockutils [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:20:09.568568 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO dbcounter [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Registered counter for database nova_cell0 Jun 04 18:20:09.572104 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_db.sqlalchemy.engines [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:20:09.572728 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO dbcounter [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Registered counter for database nova_cell1 Jun 04 18:20:09.574787 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_db.sqlalchemy.engines [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:20:09.579003 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writer thread running {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:20:09.579656 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:20:09.584618 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writer thread running {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:20:09.588847 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:20:09.715072 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writer thread running {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:20:09.725064 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO dbcounter [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Registered counter for database nova_cell0 Jun 04 18:20:09.725646 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writer thread running {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:20:09.734450 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_db.sqlalchemy.engines [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:20:09.734684 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO dbcounter [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Registered counter for database nova_cell0 Jun 04 18:20:09.740152 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writer thread running {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:20:09.743295 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:20:09.747579 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writer thread running {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:20:10.198918 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: WARNING keystonemiddleware.auth_token [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 18:20:10.199813 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: WARNING keystonemiddleware.auth_token [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 18:20:10.206488 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: WARNING keystonemiddleware.auth_token [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 18:20:10.207160 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: WARNING keystonemiddleware.auth_token [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 18:20:10.425341 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: WARNING keystonemiddleware.auth_token [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 18:20:10.431326 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: WARNING keystonemiddleware.auth_token [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 18:20:10.434332 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: WARNING keystonemiddleware.auth_token [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 18:20:10.436772 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590ddd009c0 pid: 103128 (default app) Jun 04 18:20:10.439917 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:20:10.440388 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: WARNING keystonemiddleware.auth_token [None req-b0c75b73-a5a9-4963-bf2b-db118bcebc95 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 18:20:10.441130 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002788 Jun 04 18:20:10.441541 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Sat Jun 4 18:20:10 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:20:10.446574 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5590ddd009c0 pid: 103129 (default app) Jun 04 18:21:29.507310 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:29.508404 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 04 18:21:29.509014 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:29.520959 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_api:SELECT=3 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:29.522083 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_cell0:SELECT=3 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:29.522795 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_cell1:SELECT=3 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:29.523715 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:29.939956 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-6e6f93d4-f50d-4a05-bdc5-f6387b1a256c admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:29.970350 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-6e6f93d4-f50d-4a05-bdc5-f6387b1a256c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.454537 Jun 04 18:21:29.970776 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 4 18:21:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:21:32.299597 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:32.300598 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-7f0b4a34-3ff4-412d-ae57-dbe27c2a2b7d None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jun 04 18:21:32.300985 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:32.360324 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-ca3893a8-b90e-4852-a5cd-c6531ad999fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "c1", "ram": 256, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:32.378552 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:21:32.378552 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: warnings.warn(msg) Jun 04 18:21:32.410384 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-ca3893a8-b90e-4852-a5cd-c6531ad999fe admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102591 Jun 04 18:21:32.419311 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:32.627253 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-3a18510d-7e89-426f-b8e7-90e9a38f8495 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:32.629720 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:21:32.629720 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: warnings.warn(msg) Jun 04 18:21:32.632462 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_api:SELECT=3 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:32.633425 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_cell1:SELECT=3 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:32.634212 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_cell0:SELECT=3 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:32.634896 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:32.697196 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-3a18510d-7e89-426f-b8e7-90e9a38f8495 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276571 Jun 04 18:21:32.700069 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 4 18:21:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:21:34.996135 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-ca3893a8-b90e-4852-a5cd-c6531ad999fe admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:34.997741 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-ca3893a8-b90e-4852-a5cd-c6531ad999fe admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002469 Jun 04 18:21:34.998602 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:35.109650 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-2a6a04c1-214c-4b2b-980b-1ba0b2c4b96d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "rxtx_factor": 1.0, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:35.127469 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:21:35.127469 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: warnings.warn(msg) Jun 04 18:21:35.148358 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-2a6a04c1-214c-4b2b-980b-1ba0b2c4b96d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143129 Jun 04 18:21:35.149120 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:35.160940 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-b94a29e6-cac6-4016-91e6-f933ca897970 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:35.162526 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:21:35.162526 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: warnings.warn(msg) Jun 04 18:21:35.196969 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-b94a29e6-cac6-4016-91e6-f933ca897970 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039607 Jun 04 18:21:35.204476 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 4 18:21:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:21:37.502350 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-2a6a04c1-214c-4b2b-980b-1ba0b2c4b96d admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:37.504022 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-2a6a04c1-214c-4b2b-980b-1ba0b2c4b96d admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Jun 04 18:21:37.504415 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:37.567352 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-58522d9b-cb58-4303-9b56-4acd7b6d7221 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:37.587057 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-58522d9b-cb58-4303-9b56-4acd7b6d7221 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076718 Jun 04 18:21:37.587705 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:37.600156 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-33267ca2-97c6-4bfa-a81c-a19e4da0a5e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:37.626617 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-33267ca2-97c6-4bfa-a81c-a19e4da0a5e8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030303 Jun 04 18:21:37.635894 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 4 18:21:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:21:39.962372 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-58522d9b-cb58-4303-9b56-4acd7b6d7221 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:39.963587 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-58522d9b-cb58-4303-9b56-4acd7b6d7221 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jun 04 18:21:39.964380 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:40.031266 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-95949f87-3b4e-4495-a21e-591422aa05bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:40.055286 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-95949f87-3b4e-4495-a21e-591422aa05bd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084152 Jun 04 18:21:40.055861 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:40.069688 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-17f989e2-9fe8-447e-a4b8-a2de00831d44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:40.096365 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-17f989e2-9fe8-447e-a4b8-a2de00831d44 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030874 Jun 04 18:21:40.097000 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 4 18:21:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:21:42.414767 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-95949f87-3b4e-4495-a21e-591422aa05bd admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:42.416975 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-95949f87-3b4e-4495-a21e-591422aa05bd admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002509 Jun 04 18:21:42.417532 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:42.480474 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-1d3262b1-83cf-4c93-8f2e-17c2bbe914a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:42.500233 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-1d3262b1-83cf-4c93-8f2e-17c2bbe914a8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076617 Jun 04 18:21:42.504108 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:42.513344 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-3755cfb7-48f6-49c6-8dc2-ff20950d1924 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:42.539238 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-3755cfb7-48f6-49c6-8dc2-ff20950d1924 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029751 Jun 04 18:21:42.548683 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 4 18:21:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:21:44.824361 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-1d3262b1-83cf-4c93-8f2e-17c2bbe914a8 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:44.825962 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-1d3262b1-83cf-4c93-8f2e-17c2bbe914a8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002163 Jun 04 18:21:44.826550 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:44.886683 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-e140724e-4cb8-4820-b5b3-52c4879615ed admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:44.910179 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-e140724e-4cb8-4820-b5b3-52c4879615ed admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076872 Jun 04 18:21:44.910992 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 4 18:21:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:21:47.538358 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-1d3262b1-83cf-4c93-8f2e-17c2bbe914a8 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:47.539664 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-1d3262b1-83cf-4c93-8f2e-17c2bbe914a8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Jun 04 18:21:47.540599 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:47.609155 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-d614ce77-b10c-479b-a788-50bfa5ba1057 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:47.628548 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-d614ce77-b10c-479b-a788-50bfa5ba1057 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080765 Jun 04 18:21:47.629089 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:47.641721 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-8db1decb-16c0-429f-96df-44dca5c2b473 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:47.669519 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-8db1decb-16c0-429f-96df-44dca5c2b473 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031817 Jun 04 18:21:47.670064 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 4 18:21:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:21:50.460082 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-d614ce77-b10c-479b-a788-50bfa5ba1057 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:50.461638 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-d614ce77-b10c-479b-a788-50bfa5ba1057 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002245 Jun 04 18:21:50.462304 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:50.531051 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-b26eb590-d761-40c3-baa3-7e5ca6d0ff9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "ram": 2048}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:50.555063 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-b26eb590-d761-40c3-baa3-7e5ca6d0ff9c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085642 Jun 04 18:21:50.555628 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:50.567985 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-b45037e8-4a25-40e9-9e36-deecae8bf7f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:50.593562 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-b45037e8-4a25-40e9-9e36-deecae8bf7f6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029326 Jun 04 18:21:50.594190 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 4 18:21:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:21:53.238810 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-b26eb590-d761-40c3-baa3-7e5ca6d0ff9c admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:53.239833 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-b26eb590-d761-40c3-baa3-7e5ca6d0ff9c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 04 18:21:53.240301 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:53.300051 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-dc4ba51a-9b35-4019-acee-341cd9f44d08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:53.319775 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-dc4ba51a-9b35-4019-acee-341cd9f44d08 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073501 Jun 04 18:21:53.320620 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:53.332714 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-c1dc0cb0-8cd0-4510-a6bb-d902060a645c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:53.356810 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-c1dc0cb0-8cd0-4510-a6bb-d902060a645c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027812 Jun 04 18:21:53.357403 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 4 18:21:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:21:55.656217 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-dc4ba51a-9b35-4019-acee-341cd9f44d08 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:55.657845 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-dc4ba51a-9b35-4019-acee-341cd9f44d08 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Jun 04 18:21:55.658411 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:55.717804 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-29fde1df-9d0e-479a-9b53-d929157c9eb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:55.739089 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-29fde1df-9d0e-479a-9b53-d929157c9eb4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074656 Jun 04 18:21:55.739916 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:55.751878 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-1f81615b-dc5a-4a75-834f-05d87100ca63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:55.777084 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-1f81615b-dc5a-4a75-834f-05d87100ca63 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029004 Jun 04 18:21:55.778026 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 4 18:21:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:21:58.126297 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-29fde1df-9d0e-479a-9b53-d929157c9eb4 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:21:58.127318 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-29fde1df-9d0e-479a-9b53-d929157c9eb4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 04 18:21:58.127715 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:21:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:21:58.188269 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-3e644143-c4b1-4d30-8e63-db818b8fc565 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:58.209179 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-3e644143-c4b1-4d30-8e63-db818b8fc565 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075360 Jun 04 18:21:58.209739 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 4 18:21:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:21:58.224226 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-306322fa-40d0-41f0-bdbb-c1d432f56dbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:21:58.252742 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-306322fa-40d0-41f0-bdbb-c1d432f56dbc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030270 Jun 04 18:21:58.253739 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 4 18:21:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:22:21.479965 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-3e644143-c4b1-4d30-8e63-db818b8fc565 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:21.481045 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-3e644143-c4b1-4d30-8e63-db818b8fc565 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Jun 04 18:22:21.481442 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:22:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:22:21.492516 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:22:21.548258 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-b1c7b083-0397-4da2-9082-91fd21f372e4 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:21.568627 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-b1c7b083-0397-4da2-9082-91fd21f372e4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080743 Jun 04 18:22:21.569100 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 4 18:22:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:22:22.582384 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-3e644143-c4b1-4d30-8e63-db818b8fc565 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:22.583423 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-3e644143-c4b1-4d30-8e63-db818b8fc565 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 04 18:22:22.583822 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:22:22.820673 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-04359691-e79c-4462-a6a5-1ec9a307ca47 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:22.826650 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.wsgi [None req-04359691-e79c-4462-a6a5-1ec9a307ca47 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-04359691-e79c-4462-a6a5-1ec9a307ca47 admin admin] Request method failure captured: Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Accept: application/json Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Accept-Encoding: gzip, deflate Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Connection: keep-alive Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Content-Length: 0 Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Host: 10.222.0.39 Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Openstack-Api-Version: compute 2.90 Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Openstack-System-Scope: None Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: User-Agent: python-novaclient Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Auth-Token: gAAAAABim6LeoQIHlt9Mrbg8276wiW_nEjZgJEo1Ghpp3JlZt_OKf4p_nmszJffDeNISIcjRMYxaWliISvABv767R_7H2vROOyuLA64LVGCFWfWepTNnN3TKbuI2zyiarLIPv02GENPBM5J0rWLJgtjUs4kkToCKpZEIigCMMX2L8j7dJczKB3o Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Domain-Id: None Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Domain-Name: None Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Identity-Status: Confirmed Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Is-Admin-Project: True Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Domain-Id: default Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Domain-Name: Default Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Name: admin Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Role: admin,reader,member Jun 04 18:22:22.829935 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Roles: admin,reader,member Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}] Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Tenant: admin Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Tenant-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Tenant-Name: admin Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User: admin Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Domain-Id: default Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Domain-Name: Default Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Id: ad4863301fe44ec5b40adc370b3a51b3 Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Name: admin Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: method: > Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: exception: Flavor 42 could not be found. Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: action_args: {'id': '42'} Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:22:22.831563 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:22.832680 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.834109 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-04359691-e79c-4462-a6a5-1ec9a307ca47 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:22:22.835334 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-04359691-e79c-4462-a6a5-1ec9a307ca47 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073814 Jun 04 18:22:22.835334 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 4 18:22:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:22.841903 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-fbd5ce1f-3437-4c5b-a9d8-4eecf5758be1 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:22.844874 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:22:22.865816 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-fbd5ce1f-3437-4c5b-a9d8-4eecf5758be1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028056 Jun 04 18:22:22.866408 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 4 18:22:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:22:22.883187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-66a445f1-f9ef-4e6e-9612-69d5c0c556f4 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:22.909421 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-66a445f1-f9ef-4e6e-9612-69d5c0c556f4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032065 Jun 04 18:22:22.909970 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 4 18:22:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:22:22.921195 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-917bd729-57ec-4576-9202-0b7288231c75 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:22.927836 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.wsgi [None req-917bd729-57ec-4576-9202-0b7288231c75 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-917bd729-57ec-4576-9202-0b7288231c75 admin admin] Request method failure captured: Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Accept: application/json Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Accept-Encoding: gzip, deflate Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Connection: keep-alive Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Content-Length: 0 Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Host: 10.222.0.39 Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Openstack-Api-Version: compute 2.90 Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Openstack-System-Scope: None Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: User-Agent: python-novaclient Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Auth-Token: gAAAAABim6LeoQIHlt9Mrbg8276wiW_nEjZgJEo1Ghpp3JlZt_OKf4p_nmszJffDeNISIcjRMYxaWliISvABv767R_7H2vROOyuLA64LVGCFWfWepTNnN3TKbuI2zyiarLIPv02GENPBM5J0rWLJgtjUs4kkToCKpZEIigCMMX2L8j7dJczKB3o Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Domain-Id: None Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Domain-Name: None Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Identity-Status: Confirmed Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Is-Admin-Project: True Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Domain-Id: default Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Domain-Name: Default Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Name: admin Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Role: admin,reader,member Jun 04 18:22:22.931271 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Roles: admin,reader,member Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}] Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Tenant: admin Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Tenant-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Tenant-Name: admin Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User: admin Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Domain-Id: default Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Domain-Name: Default Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Id: ad4863301fe44ec5b40adc370b3a51b3 Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Name: admin Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: method: > Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: exception: Flavor 42 could not be found. Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: action_args: {'id': '42'} Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:22:22.932819 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:22.933746 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:22.934826 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-917bd729-57ec-4576-9202-0b7288231c75 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:22:22.936026 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-917bd729-57ec-4576-9202-0b7288231c75 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015361 Jun 04 18:22:22.936026 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 4 18:22:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:23.796421 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-66a445f1-f9ef-4e6e-9612-69d5c0c556f4 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:23.797459 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-66a445f1-f9ef-4e6e-9612-69d5c0c556f4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jun 04 18:22:23.797853 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:22:23.995639 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-0a149cac-5671-4161-9e3f-b9ef93eccd9a admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:24.001976 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.wsgi [None req-0a149cac-5671-4161-9e3f-b9ef93eccd9a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-0a149cac-5671-4161-9e3f-b9ef93eccd9a admin admin] Request method failure captured: Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Accept: application/json Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Accept-Encoding: gzip, deflate Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Connection: keep-alive Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Content-Length: 0 Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Host: 10.222.0.39 Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Openstack-Api-Version: compute 2.90 Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Openstack-System-Scope: None Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: User-Agent: python-novaclient Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Auth-Token: gAAAAABim6Lfk3HtoRb5c2k7F91NNVctDljiuJ84SzPCn76Lz7043J5vSV-8maEmO7LQT3iAb4om-sRV6En8FXZ-1zWgYRfF8G97_N8kM9unzk7PjEvGeg1RG0lrKuGPlOZBJTRzbxQpMbzQwT56kUzBxTZdwUn2lh30bNoMvpdNM8iOiS48tOw Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Domain-Id: None Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Domain-Name: None Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Identity-Status: Confirmed Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Is-Admin-Project: True Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Domain-Id: default Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Domain-Name: Default Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Name: admin Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Role: admin,reader,member Jun 04 18:22:24.003422 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Roles: admin,reader,member Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}] Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Tenant: admin Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Tenant-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Tenant-Name: admin Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User: admin Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Domain-Id: default Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Domain-Name: Default Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Id: ad4863301fe44ec5b40adc370b3a51b3 Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Name: admin Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: method: > Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: exception: Flavor 84 could not be found. Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: action_args: {'id': '84'} Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:22:24.005024 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:24.005844 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.006866 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-0a149cac-5671-4161-9e3f-b9ef93eccd9a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:22:24.007863 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-0a149cac-5671-4161-9e3f-b9ef93eccd9a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068837 Jun 04 18:22:24.007863 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 4 18:22:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:24.015031 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-61b15adf-6a7f-4c0c-b568-8f733be9a85f admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:24.029245 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-61b15adf-6a7f-4c0c-b568-8f733be9a85f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017875 Jun 04 18:22:24.029753 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 4 18:22:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:22:24.039308 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-a30378b6-4772-49e0-a64d-a3b7f45e27b5 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:24.054520 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-a30378b6-4772-49e0-a64d-a3b7f45e27b5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018775 Jun 04 18:22:24.055052 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 4 18:22:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:22:24.064473 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-4fdedb6b-ce8d-472f-a786-e76607d2b3db admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:24.070126 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.wsgi [None req-4fdedb6b-ce8d-472f-a786-e76607d2b3db admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-4fdedb6b-ce8d-472f-a786-e76607d2b3db admin admin] Request method failure captured: Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Accept: application/json Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Accept-Encoding: gzip, deflate Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Connection: keep-alive Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Content-Length: 0 Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Host: 10.222.0.39 Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Openstack-Api-Version: compute 2.90 Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Openstack-System-Scope: None Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: User-Agent: python-novaclient Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Auth-Token: gAAAAABim6Lfk3HtoRb5c2k7F91NNVctDljiuJ84SzPCn76Lz7043J5vSV-8maEmO7LQT3iAb4om-sRV6En8FXZ-1zWgYRfF8G97_N8kM9unzk7PjEvGeg1RG0lrKuGPlOZBJTRzbxQpMbzQwT56kUzBxTZdwUn2lh30bNoMvpdNM8iOiS48tOw Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Domain-Id: None Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Domain-Name: None Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Identity-Status: Confirmed Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Is-Admin-Project: True Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Domain-Id: default Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Domain-Name: Default Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Name: admin Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Role: admin,reader,member Jun 04 18:22:24.071636 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Roles: admin,reader,member Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}] Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Tenant: admin Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Tenant-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Tenant-Name: admin Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User: admin Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Domain-Id: default Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Domain-Name: Default Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Id: ad4863301fe44ec5b40adc370b3a51b3 Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Name: admin Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: method: > Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: exception: Flavor 84 could not be found. Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: action_args: {'id': '84'} Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:22:24.073590 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:24.074699 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:24.075758 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-4fdedb6b-ce8d-472f-a786-e76607d2b3db admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:22:24.076770 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-4fdedb6b-ce8d-472f-a786-e76607d2b3db admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012127 Jun 04 18:22:24.076770 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 4 18:22:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:24.951217 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-a30378b6-4772-49e0-a64d-a3b7f45e27b5 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:24.952288 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-a30378b6-4772-49e0-a64d-a3b7f45e27b5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 04 18:22:24.952682 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:22:25.157996 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-e189c5fb-943c-4e2b-bdfd-8aba2c24a0d7 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:25.163982 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.wsgi [None req-e189c5fb-943c-4e2b-bdfd-8aba2c24a0d7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-e189c5fb-943c-4e2b-bdfd-8aba2c24a0d7 admin admin] Request method failure captured: Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Accept: application/json Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Accept-Encoding: gzip, deflate Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Connection: keep-alive Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Content-Length: 0 Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Host: 10.222.0.39 Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Openstack-Api-Version: compute 2.90 Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Openstack-System-Scope: None Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: User-Agent: python-novaclient Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Auth-Token: gAAAAABim6LgBTC6XFA_t2gOnojkskTuudIWQCmSgdmwrjKCHDsMVVCpH-wZWXwelDHbeZ3OAdz9XlWHbB0t6jCFx0L0y9WBj0OahKUamPqh3YqymkZRQFf-k7f1Uf-Q8fPVDZc_IVyd-JSoi_7DoRh0KqHLyd1HTLK85fvrxu6AV6P3k9jhIlQ Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Domain-Id: None Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Domain-Name: None Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Identity-Status: Confirmed Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Is-Admin-Project: True Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Domain-Id: default Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Domain-Name: Default Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Project-Name: admin Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Role: admin,reader,member Jun 04 18:22:25.165532 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Roles: admin,reader,member Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}] Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Tenant: admin Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Tenant-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-Tenant-Name: admin Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User: admin Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Domain-Id: default Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Domain-Name: Default Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Id: ad4863301fe44ec5b40adc370b3a51b3 Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: X-User-Name: admin Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: method: > Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: exception: Flavor 451 could not be found. Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: action_args: {'id': '451'} Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:22:25.167265 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:25.168187 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.169249 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-e189c5fb-943c-4e2b-bdfd-8aba2c24a0d7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:22:25.170386 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-e189c5fb-943c-4e2b-bdfd-8aba2c24a0d7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072682 Jun 04 18:22:25.170386 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 4 18:22:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:25.177446 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-3e8d7dfa-6797-448c-9df0-63855b806cad admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:25.192118 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-3e8d7dfa-6797-448c-9df0-63855b806cad admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018362 Jun 04 18:22:25.192648 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 4 18:22:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:22:25.202372 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:25.216594 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017768 Jun 04 18:22:25.217154 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 4 18:22:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:22:25.226948 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-8af0f873-5d2a-456d-b6ab-ee8c35250666 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:25.232737 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.wsgi [None req-8af0f873-5d2a-456d-b6ab-ee8c35250666 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-8af0f873-5d2a-456d-b6ab-ee8c35250666 admin admin] Request method failure captured: Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Accept: application/json Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Accept-Encoding: gzip, deflate Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Connection: keep-alive Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Content-Length: 0 Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Host: 10.222.0.39 Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Openstack-Api-Version: compute 2.90 Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Openstack-System-Scope: None Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: User-Agent: python-novaclient Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Auth-Token: gAAAAABim6LgBTC6XFA_t2gOnojkskTuudIWQCmSgdmwrjKCHDsMVVCpH-wZWXwelDHbeZ3OAdz9XlWHbB0t6jCFx0L0y9WBj0OahKUamPqh3YqymkZRQFf-k7f1Uf-Q8fPVDZc_IVyd-JSoi_7DoRh0KqHLyd1HTLK85fvrxu6AV6P3k9jhIlQ Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Domain-Id: None Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Domain-Name: None Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Identity-Status: Confirmed Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Is-Admin-Project: True Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Domain-Id: default Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Domain-Name: Default Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Project-Name: admin Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Role: admin,reader,member Jun 04 18:22:25.234232 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Roles: admin,reader,member Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b474e20b865e43bf8fbbb839d2f225c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b474e20b865e43bf8fbbb839d2f225c5"}]}] Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Tenant: admin Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Tenant-Id: b474e20b865e43bf8fbbb839d2f225c5 Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-Tenant-Name: admin Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User: admin Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Domain-Id: default Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Domain-Name: Default Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Id: ad4863301fe44ec5b40adc370b3a51b3 Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: X-User-Name: admin Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: method: > Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: exception: Flavor 451 could not be found. Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: action_args: {'id': '451'} Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:22:25.235721 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:25.236814 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: ERROR nova.api.openstack.wsgi Jun 04 18:22:25.238174 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-8af0f873-5d2a-456d-b6ab-ee8c35250666 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:22:25.239409 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-8af0f873-5d2a-456d-b6ab-ee8c35250666 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012368 Jun 04 18:22:25.239409 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 4 18:22:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:26.107663 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:26.108732 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 04 18:22:26.109120 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:22:26.311155 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-191cd741-c690-4c2f-bec3-910303dfba79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:22:26.334438 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-191cd741-c690-4c2f-bec3-910303dfba79 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.090201 Jun 04 18:22:26.334996 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Sat Jun 4 18:22:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:22:27.202830 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:27.203848 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 04 18:22:27.204308 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:22:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:22:27.408752 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-521b39ee-b8bf-4fe2-8cf1-6508c777e810 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:22:27.430849 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-521b39ee-b8bf-4fe2-8cf1-6508c777e810 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.089651 Jun 04 18:22:27.431406 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Sat Jun 4 18:22:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:22:28.306204 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:28.307158 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 04 18:22:28.307597 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:22:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:22:28.496743 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-622af36f-c8a1-487a-8275-558583784d68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:22:28.517991 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-622af36f-c8a1-487a-8275-558583784d68 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075063 Jun 04 18:22:28.518455 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Sat Jun 4 18:22:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:22:29.397254 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:29.398606 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Jun 04 18:22:29.399152 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:22:29.597146 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-27b9b45b-5341-4208-af00-873691008960 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:22:29.618286 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-27b9b45b-5341-4208-af00-873691008960 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.083631 Jun 04 18:22:29.618766 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Sat Jun 4 18:22:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 18:22:30.512340 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:30.513376 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 04 18:22:30.513807 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:22:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:22:30.707234 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-6eb129d8-781a-48ee-8bca-844ee01d8e12 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:22:30.727352 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-6eb129d8-781a-48ee-8bca-844ee01d8e12 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079017 Jun 04 18:22:30.727881 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Sat Jun 4 18:22:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:23:31.936712 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:23:31.938032 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-5c293e2d-b372-480e-a33b-a496a3fdfe18 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001905 Jun 04 18:23:31.938526 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 4 18:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:23:31.948921 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:23:32.009950 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-6d6808d9-673f-4234-802e-c534bd106ee9 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:23:32.037154 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-6d6808d9-673f-4234-802e-c534bd106ee9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.089934 Jun 04 18:23:32.037704 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 4 18:23:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:23:32.059168 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG dbcounter [-] [103129] Writing DB stats nova_api:SELECT=14 {{(pid=103129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:23:32.062852 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-2c84a10e-40e1-444d-aea9-568d166bbdcc admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:23:32.070654 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-2c84a10e-40e1-444d-aea9-568d166bbdcc admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013083 Jun 04 18:23:32.071190 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1282 bytes} [Sat Jun 4 18:23:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:23:32.082624 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-9f633dda-9d50-41cb-94f9-148976e19abe admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:23:32.091115 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-9f633dda-9d50-41cb-94f9-148976e19abe admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012111 Jun 04 18:23:32.091631 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1285 bytes} [Sat Jun 4 18:23:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:23:32.102829 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:23:32.111381 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012077 Jun 04 18:23:32.111839 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1285 bytes} [Sat Jun 4 18:23:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:23:32.123054 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-303dd037-07dc-4b30-8a41-27dfcd01dc7a admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:23:32.130759 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-303dd037-07dc-4b30-8a41-27dfcd01dc7a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011371 Jun 04 18:23:32.131264 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1282 bytes} [Sat Jun 4 18:23:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:26:47.329752 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:26:47.331093 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002067 Jun 04 18:26:47.331646 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:26:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:26:47.486029 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_api:SELECT=6 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:26:47.615218 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-25575b40-37e9-4bf1-9973-ea747857b653 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:26:47.616773 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:26:47.616773 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: warnings.warn(msg) Jun 04 18:26:47.618801 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-25575b40-37e9-4bf1-9973-ea747857b653 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:26:47.619293 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-25575b40-37e9-4bf1-9973-ea747857b653 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:26:47.620145 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-25575b40-37e9-4bf1-9973-ea747857b653 admin admin] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:26:47.620577 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-25575b40-37e9-4bf1-9973-ea747857b653 admin admin] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:26:47.655515 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-25575b40-37e9-4bf1-9973-ea747857b653 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.172142 Jun 04 18:26:47.656143 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 4 18:26:47 2022] GET /compute/v2.1/os-services => generated 794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:26:48.527460 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:26:48.528513 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 04 18:26:48.528977 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:26:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:26:48.729019 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-079f6c94-ed91-4244-8b11-3b0ca1dbe315 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:26:48.730204 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:26:48.730204 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: warnings.warn(msg) Jun 04 18:26:48.731405 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-079f6c94-ed91-4244-8b11-3b0ca1dbe315 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:26:48.731850 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-079f6c94-ed91-4244-8b11-3b0ca1dbe315 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:26:48.732666 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-079f6c94-ed91-4244-8b11-3b0ca1dbe315 admin admin] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:26:48.733094 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-079f6c94-ed91-4244-8b11-3b0ca1dbe315 admin admin] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:26:48.752693 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-079f6c94-ed91-4244-8b11-3b0ca1dbe315 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079658 Jun 04 18:26:48.753345 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 4 18:26:48 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:27:00.082980 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:27:00.084029 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 04 18:27:00.084440 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:27:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:27:00.228898 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_cell0:SELECT=4 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:27:00.229611 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_cell1:SELECT=4 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:27:00.230212 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG dbcounter [-] [103128] Writing DB stats nova_api:SELECT=8 {{(pid=103128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:27:00.288520 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-42fe6a06-da98-4710-90b4-34c9b9c0c2c4 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:27:00.290066 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:27:00.290066 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: warnings.warn(msg) Jun 04 18:27:00.291616 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-42fe6a06-da98-4710-90b4-34c9b9c0c2c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:27:00.292055 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-42fe6a06-da98-4710-90b4-34c9b9c0c2c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:27:00.292883 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-42fe6a06-da98-4710-90b4-34c9b9c0c2c4 admin admin] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:27:00.293313 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-42fe6a06-da98-4710-90b4-34c9b9c0c2c4 admin admin] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:27:00.320062 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-42fe6a06-da98-4710-90b4-34c9b9c0c2c4 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.096815 Jun 04 18:27:00.321037 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 38/74] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 4 18:27:00 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:27:01.193987 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: DEBUG nova.api.openstack.wsgi [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] Calling method '>' {{(pid=103129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:27:01.195081 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: INFO nova.api.openstack.requestlog [None req-a3ea3984-856e-499e-a077-b623e991547b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jun 04 18:27:01.195473 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: [pid: 103129|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 4 18:27:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:27:01.394873 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG nova.api.openstack.wsgi [None req-d9529982-bc82-4c80-a333-97eb5dd17a30 admin admin] Calling method '>' {{(pid=103128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:27:01.396240 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:27:01.396240 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: warnings.warn(msg) Jun 04 18:27:01.397445 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-d9529982-bc82-4c80-a333-97eb5dd17a30 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:27:01.398119 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-d9529982-bc82-4c80-a333-97eb5dd17a30 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:27:01.399071 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-d9529982-bc82-4c80-a333-97eb5dd17a30 admin admin] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:27:01.399500 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: DEBUG oslo_concurrency.lockutils [None req-d9529982-bc82-4c80-a333-97eb5dd17a30 admin admin] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:27:01.421619 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: INFO nova.api.openstack.requestlog [None req-d9529982-bc82-4c80-a333-97eb5dd17a30 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.088687 Jun 04 18:27:01.422178 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: [pid: 103128|app: 0|req: 39/76] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 4 18:27:01 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:27:58.706952 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: Sat Jun 4 18:27:58 2022 - graceful shutdown triggered... Jun 04 18:27:58.707039 dv-cinder-790535-41-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 04 18:27:58.708099 dv-cinder-790535-41-iscsi devstack@n-api.service[103128]: Gracefully killing worker 1 (pid: 103128)... Jun 04 18:27:58.708537 dv-cinder-790535-41-iscsi devstack@n-api.service[103129]: Gracefully killing worker 2 (pid: 103129)... Jun 04 18:27:59.709257 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: worker 1 buried after 1 seconds Jun 04 18:27:59.709257 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: worker 2 buried after 1 seconds Jun 04 18:27:59.709257 dv-cinder-790535-41-iscsi devstack@n-api.service[103127]: goodbye to uWSGI. Jun 04 18:27:59.710868 dv-cinder-790535-41-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 04 18:27:59.711442 dv-cinder-790535-41-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 04 18:27:59.714241 dv-cinder-790535-41-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 04 18:27:59.729690 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 18:27:59 2022] *** Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: nodename: dv-cinder-790535-41-iscsi Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: machine: x86_64 Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: clock source: unix Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: pcre jit disabled Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: detected number of CPU cores: 4 Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: current working directory: / Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: detected binary path: /usr/bin/uwsgi-core Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: your processes number limit is 47680 Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: your memory page size is 4096 bytes Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: detected max file descriptor number: 2048 Jun 04 18:27:59.741240 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: lock engine: pthread robust mutexes Jun 04 18:27:59.742232 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: thunder lock: enabled Jun 04 18:27:59.742232 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 04 18:27:59.742232 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 18:27:59.789128 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: Python main interpreter initialized at 0x560e3099f9c0 Jun 04 18:27:59.789128 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: python threads support enabled Jun 04 18:27:59.789128 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: your server socket listen backlog is limited to 100 connections Jun 04 18:27:59.789128 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: your mercy for graceful operations on workers is 90 seconds Jun 04 18:27:59.789559 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 18:27:59.789559 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: *** Operational MODE: preforking *** Jun 04 18:27:59.789836 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: *** uWSGI is running in multiple interpreter mode *** Jun 04 18:27:59.789836 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: spawned uWSGI master process (pid: 117715) Jun 04 18:27:59.790065 dv-cinder-790535-41-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 04 18:27:59.792035 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: spawned uWSGI worker 1 (pid: 117731, cores: 1) Jun 04 18:27:59.792035 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: spawned uWSGI worker 2 (pid: 117732, cores: 1) Jun 04 18:27:59.792035 dv-cinder-790535-41-iscsi devstack@n-api.service[117715]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 18:28:01.006555 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 18:28:01.023319 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 18:28:01.831451 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:28:01.831451 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: from cryptography.utils import int_from_bytes Jun 04 18:28:01.831788 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:28:01.831788 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: from cryptography.utils import int_from_bytes Jun 04 18:28:01.836459 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:28:01.836459 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: from cryptography.utils import int_from_bytes Jun 04 18:28:01.836801 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:28:01.836801 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: from cryptography.utils import int_from_bytes Jun 04 18:28:04.157912 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 18:28:04.158595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 18:28:04.158717 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 18:28:04.159259 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 18:28:04.159685 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 18:28:04.160258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.160736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.161237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.161706 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.162196 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.162657 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.163147 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.163634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.164151 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.164581 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.165049 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.165537 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-41-iscsi {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.166359 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.166845 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.167322 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.167800 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.168284 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.168754 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.169231 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.170191 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.170546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 18:28:04.171215 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 18:28:04.171335 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 18:28:04.171901 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.172312 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 18:28:04.172580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.172850 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 18:28:04.172934 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.173179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.173179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.173504 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.173580 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.173649 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.173729 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.173801 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.173881 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.173964 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.174235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.174355 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.174636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.174958 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.175120 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.175378 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-41-iscsi {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.175709 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.175903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.176091 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.176397 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.176739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.176850 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.177249 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.177369 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.177581 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.177911 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.178118 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.178242 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.178562 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.178864 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-41-iscsi {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.179011 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.179237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.179566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.179772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.179896 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.180238 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.180555 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.180705 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.181390 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.181390 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.181560 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.181772 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.182056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.182195 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.182333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.182828 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.183059 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.183313 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.183442 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.183723 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.183919 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.184218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.184324 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.184488 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.184748 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.184863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.185072 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.185173 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.185388 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.185512 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.185706 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.185812 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.186047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.186177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.186366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.186529 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.186683 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.186835 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.186991 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.187168 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.187531 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.187623 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.187828 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.188089 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.188252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.188450 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.188606 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-41-iscsi {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.188759 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.188926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.189072 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.189228 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.189371 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.189519 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.189660 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.189831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.189989 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.190142 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.190292 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.190481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.190635 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.190788 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.190939 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.191089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.191237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.191378 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.191519 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.191659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.191808 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.192023 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.192184 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.192334 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.192554 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.192700 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.192852 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.192994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.193135 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.193276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.193417 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.193564 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.193719 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.193870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.194031 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.194182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.194326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.194480 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.194628 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.194777 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.194929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.195078 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.195078 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.195456 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.195608 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.195759 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.195947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.196128 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.196280 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.196437 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.196636 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.196785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.196927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.197078 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.197235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.197385 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.197537 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.197687 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.197852 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.197994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.198144 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.198291 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.198434 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.198580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.198722 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.198869 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.199028 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.199179 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.199328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.199478 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.199620 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.199779 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.199922 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.200117 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.200273 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.200421 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.200571 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.200767 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.200920 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.201061 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.201213 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.201367 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.201519 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.201682 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.201831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.201979 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.202129 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.202272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.202412 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.202561 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.202704 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.202898 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.203301 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.203827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.203981 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.204201 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.204370 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.204370 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.204708 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.204708 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.205003 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.205151 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.205321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.205549 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.205703 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.205854 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.206004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.206161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.206303 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.206470 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.206612 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.206760 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.206903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.207043 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.207184 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.207340 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.207482 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.207629 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.207778 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.207931 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.208095 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.208287 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.208454 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.208597 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.208738 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.208919 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.209078 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.209220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.209372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.209521 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.209663 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.209810 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.209969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.210118 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.210260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.210418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.210568 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.210718 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.210874 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.210874 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.211152 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.211294 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.211434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.211574 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.211723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.211871 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.212032 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.212200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.212344 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.212495 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.212636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.212815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.212970 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.213127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.213269 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.213420 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.213569 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.213719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.213868 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.214017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.214170 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.214311 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.214461 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.214603 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.214767 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.214910 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.215068 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.215212 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.215351 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.215492 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.215803 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.215951 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.216165 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.216354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.216509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.216659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.216801 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.216979 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.217121 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.217269 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.217269 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.217546 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.217698 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.217846 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.217988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.218140 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.218289 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.218444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.219100 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.219272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.219429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.219580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.219728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.219883 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.220045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.220206 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.220357 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.220500 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.220667 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.220857 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.221007 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.221149 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.221298 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.221440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.221600 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.221751 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.221906 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.222047 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.222199 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:28:04.222348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.222491 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.222651 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.222793 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.222935 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.223085 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.223227 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.223377 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.223530 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.223682 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.223825 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.223825 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.224136 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.224136 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.224462 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.224618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.224762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.224939 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.225086 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.225248 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.225394 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.225543 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.225701 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.225915 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.226061 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.226212 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.226362 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.226522 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.226671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.226820 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.226962 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.227112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.227253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.227394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.227534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.227683 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.227825 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.227825 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.228160 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.228160 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.228454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.228597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.228738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.228889 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.229069 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.229210 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.229358 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.229500 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.229649 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.229791 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.229940 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.229940 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.230227 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.230368 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.230523 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.230665 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.230814 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.230957 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.231097 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.231246 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.231395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.231537 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.231686 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.231827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.231977 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.232152 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.232312 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.232489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.232635 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.232784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.232926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.233112 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.233259 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.233409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.233557 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.233698 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.233846 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.233995 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.234179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.234516 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.234961 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.235109 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.235252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.235418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.235571 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.235712 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.235893 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.236169 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.236328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.236485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.236645 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.236788 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.236956 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.237133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.237286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.237436 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.237578 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.237719 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.237860 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.237860 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.238141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.238284 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.238432 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.238585 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.238734 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.238883 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.239034 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.239183 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.239333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.239482 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.239631 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.239773 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.239922 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.240153 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.240311 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.240311 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.240634 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.240788 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.240938 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.241122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.241277 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.242018 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.242176 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.242326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.242470 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.242611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.242835 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.242991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.243133 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.243273 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.243420 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.243576 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.243717 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.243858 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.243998 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.244175 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.244327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.244483 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.244626 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.244767 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.244925 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.245078 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.245227 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.245227 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.245511 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.245659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.245801 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.245949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.246099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.246366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.246520 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.246520 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.246791 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.246944 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.246944 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.247229 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.247379 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.247520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.247661 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.247801 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.247957 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.248211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.248356 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.248497 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.248637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.248798 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.248949 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.249096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.249245 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.249387 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.249538 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.249680 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.249899 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.250275 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.250800 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.250964 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.251109 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.251260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.251414 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.251563 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.251705 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.251846 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.251994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.252184 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.252327 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.252476 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.252625 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.252767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.252908 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.253102 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.253257 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.253411 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.253560 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.253703 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.253844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.253994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.254144 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.254284 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.254440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.254588 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.254743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.254891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.254891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.255190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.255369 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.255526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.255526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.255817 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.255981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.256164 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.256338 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.256503 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.256697 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.256849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.256996 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.257185 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.257348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.257504 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.257664 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.257814 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.257968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.258099 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.258225 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.258335 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.258459 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.258571 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.258706 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.258795 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.258880 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.258974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259059 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259151 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259320 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259404 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259496 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259680 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259772 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259856 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.259948 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.260066 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.260156 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.260156 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.260156 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.260391 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.260522 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.260661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.260789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.260789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261452 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261537 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261620 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261702 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261798 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.261929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262026 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262111 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262195 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262374 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262835 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.262935 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263020 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263103 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263386 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263473 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263564 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263740 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263825 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.263921 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.264077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.264167 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.264264 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.264382 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.264484 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.264697 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.264790 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.265012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.265112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.265338 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.265466 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.265708 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.266172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.266262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.266345 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.266426 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.266509 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.266692 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.266775 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.267030 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.267130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.267725 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.267845 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.267943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.268120 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.268263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.268400 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.268535 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.268743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.268882 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.269010 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.269164 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.269293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.269428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.269567 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.269695 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.269822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.269957 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.270092 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.270225 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.270353 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.270487 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.270621 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.270757 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.270884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.271024 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.271159 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.271329 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.271460 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.271652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.271784 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.271986 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.272246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.272402 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.272555 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.272704 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.272864 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.273010 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.273190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.273340 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.273504 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.273635 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.273808 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.273948 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.274121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.274260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.274425 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.274554 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.274755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.274892 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.275063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.275201 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.275368 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.275506 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.275672 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.275807 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.275980 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.276149 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.276314 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.276458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.276623 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.276761 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.276932 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.277070 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.277239 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.277375 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.277551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.277682 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.277860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.277999 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.278167 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.278295 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.278478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.278608 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.278782 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.278928 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.279089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.279219 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.279394 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.279531 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.279740 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.279871 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.280072 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.280206 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.280396 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.280516 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.280794 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.280925 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.281242 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.281678 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.281678 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.281896 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.282024 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.282143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.282260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.282378 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.282486 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.282652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.282785 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.282959 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.283085 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.283278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.283409 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.283576 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.283693 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.283880 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.283997 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.284218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.284356 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.284529 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.284647 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.284842 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.286256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.286408 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.286555 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.286690 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.286829 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.286959 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.287100 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.287236 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.287371 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.287499 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.287628 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.287767 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.287906 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.288091 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.288214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.288324 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.288432 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.288539 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.288664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.288776 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.288776 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.288980 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.289096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.289205 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.289323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.289433 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.289540 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.289650 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.289768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.289914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.290050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.290186 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.290322 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.290457 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.290585 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.291115 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.291322 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.291454 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.291580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.291706 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.291833 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.291974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.292122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.292263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.292393 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.292528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.292656 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.292775 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.292888 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.292997 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.293106 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.293214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.293337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.293461 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.293572 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.293767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.293894 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.294081 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.294213 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.294374 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.294502 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.294694 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.294817 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.294996 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.295121 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.295298 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.295421 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.295599 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.295716 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.295906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.296065 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.296240 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.296375 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.296545 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.296707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.296980 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.297510 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.297654 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.297783 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.297912 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.298040 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.298240 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.298383 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.298511 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.298638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.298765 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.298891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.299030 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.299160 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.299293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.299453 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.299583 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.299709 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.299849 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.299985 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.300149 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.300278 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.300405 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.300545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.300681 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.300807 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.300918 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.301026 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.301144 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.301263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.301468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.301737 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.301861 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.302049 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.302174 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.302368 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.302486 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.302675 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.302791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.302985 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.303103 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.303289 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.303406 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.303593 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.303718 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.303932 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.304154 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.304290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.304420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.304555 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.304683 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.304838 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.305049 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.305178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.305313 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.305449 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.305577 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.305711 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.305853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.306009 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.306147 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.306317 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.306449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.306639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.306778 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.306956 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.307087 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.307260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.307392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.308124 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.308268 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.308396 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.308525 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.308659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.308801 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.308937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.309073 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.309200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.309327 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.309461 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.309603 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.309731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.309865 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.309992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.310125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.310260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.310396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.310531 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.310660 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.310786 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.310920 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.311047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.311181 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.311315 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.311463 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.311591 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.311726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.311862 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.311990 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.312176 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.312349 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.312657 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.313210 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.313368 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.313499 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.313634 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.313763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.313889 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.314016 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.314152 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.314287 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.314425 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.314553 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.314687 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.314824 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.314961 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.314961 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.315209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.315209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.315483 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.315483 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.315744 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.315880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.316023 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.316165 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.316302 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.316440 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.316568 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.316702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.316831 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.316966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.317101 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.317243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.317370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.317552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.317684 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.317875 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.318017 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.318197 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.318336 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.318502 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.318641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.318810 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.318955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.319120 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.319260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.319423 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.319553 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.319730 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.319870 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.320056 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.320212 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.320349 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.320478 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.320661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.320888 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.321028 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.321200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.321323 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.321784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.321924 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.322062 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.322191 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.322318 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.322456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.322456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.322774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.322985 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.323190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.323406 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.323607 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.323817 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.324056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.324259 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.324458 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.324677 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.324880 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.325089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.325300 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.325504 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.325704 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.325903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.326102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.326102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.326508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.326718 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.326934 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.326934 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.327313 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.327528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.327741 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.327979 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.328307 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.328512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.328728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.328944 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.329146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.329354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.329558 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.329771 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.329973 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.330193 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.330393 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.330597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.330790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.330790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.331171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.331397 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.331670 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.331902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.332121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.332326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.332510 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.332699 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.332900 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.333095 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.333256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.333396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.333525 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.333659 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.333788 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.333924 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.334067 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.334195 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.334323 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.334464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.334600 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.334728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.334864 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.335001 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.335148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.335283 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.335410 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.335544 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.335686 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.335815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.335815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.336099 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.336232 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.336360 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.336502 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.336631 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.336758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.336894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.337023 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.337158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.337286 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.337412 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.337547 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.337683 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.337811 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.337953 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.338089 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.338223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.338352 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.338486 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.338614 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.338750 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.338891 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.339028 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.339154 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.339282 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.339407 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.339547 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.339675 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.339801 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.339936 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.340089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.340234 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.340363 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.340496 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.340630 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.340758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.340885 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.341027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.341163 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.341298 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.341435 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.341562 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.341689 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.341830 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.341958 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.342094 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.342228 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.342355 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.342489 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.342625 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.342753 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.342887 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.343015 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.343143 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.343143 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.343399 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.343571 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.344229 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.344387 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.344521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.344660 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.344789 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.344926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.345054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.345188 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.345326 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.345462 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.345601 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.345730 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.345866 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.346003 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.346138 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.346276 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.346404 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.346531 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.346658 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.346795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.346937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.347074 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.347211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.347349 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.347477 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.347612 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.347750 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.347885 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.348033 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.348177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.348315 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.348453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.348589 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.348589 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.348831 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.348971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.349099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.349099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.349347 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.349347 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.349580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.349719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.349848 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.349848 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.350110 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.350245 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.350379 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.350379 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.350628 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.350769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.350897 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.351024 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.351160 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.351287 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.351413 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.351559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.351687 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.351822 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.351950 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.352118 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.352258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.352401 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.352536 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.352679 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.352807 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.352941 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.353078 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.353217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.353345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.353472 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.353606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.353736 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.353916 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.354055 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.354221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.354359 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.354523 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.354661 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.354845 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.354981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.355132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.355263 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.355453 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.355593 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.355760 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.355891 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.356086 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.356220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.356389 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.356534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.356676 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.356807 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.357009 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.357147 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.357309 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.357449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.357638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.357776 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.357982 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.358115 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.358251 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.358385 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.358558 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.358688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.358868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.359005 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.359203 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.359819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.359956 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.360155 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.360285 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.360419 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.360560 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.360689 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.360824 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.360951 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.361077 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.361212 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.361347 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.361482 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.361610 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.361737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.361863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.362074 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.362212 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.362340 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.362503 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.362642 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.362815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.362954 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.363153 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.363379 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.363517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.363709 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.363850 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.364054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.364190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.364366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.364509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.364683 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.364822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.364995 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.365125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.365307 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.365437 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.365619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.365763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.365929 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.366060 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.366236 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.366373 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.366544 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.366687 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.366853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.366990 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.367160 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.367300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.367480 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.367618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.367789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.367920 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.368136 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.368357 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.368498 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.368712 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.368843 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.369029 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.369160 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.369357 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.369578 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.369719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.369854 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.369984 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.370122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.370263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.370400 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.370557 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.370689 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.370867 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.370999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.371175 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.371314 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.371482 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.371613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.371792 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.371932 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.372124 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.372258 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.372435 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.372573 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.372744 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.372896 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.373053 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.373185 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.373360 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.373502 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.373673 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.373812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.373980 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.374111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.374310 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.374438 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.374620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.374797 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.375395 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.375546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.375685 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.375814 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.375948 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.375948 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.376243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.376372 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.376499 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.376634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.376773 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.376902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.377029 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.377156 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.377350 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.377481 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.377674 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.377814 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.377981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.378119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.378297 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.378427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.378604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.378741 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.378909 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.379041 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.379217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.379341 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.379525 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.379650 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.379829 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.379969 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.380177 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.380320 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.380488 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.380619 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.380790 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.380921 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.381107 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.381253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.381413 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.381543 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.381724 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.381952 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.382084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.382307 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.382438 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.382626 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.382906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.383038 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.383249 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.383388 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.383570 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.383705 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.383882 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.384050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.384240 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.384379 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.384549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.384681 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.384907 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.385048 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.385188 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.385315 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.385450 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.385587 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.385757 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.385894 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.386061 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.386194 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.386374 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.386512 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.386684 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.386813 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.386990 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.387123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.387302 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.387431 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.387601 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.387740 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.387911 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.388066 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.388243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.388374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.388552 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.388696 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.388856 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.388986 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.389171 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.389308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.389470 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.389613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.389774 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.389911 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.390078 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.390208 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.390432 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.390672 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.391123 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.391262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.391391 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.391519 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.391662 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.391799 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.391935 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.392099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.392230 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.392370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.392510 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.392639 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.392774 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.392910 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.393039 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.393165 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.393306 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.393434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.393566 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.393693 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.393819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.393960 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.394095 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.394362 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.394494 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.394680 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.394819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.394988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.395119 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.395299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.395437 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.395610 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.395782 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.395944 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.396095 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.396298 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.396503 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.396644 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.396842 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.396973 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.397162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.397301 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.397492 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.397624 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.397823 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.397955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.398136 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.398266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.398447 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.398577 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.398784 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.398921 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.399064 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.399192 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.399360 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.399498 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.399670 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.399809 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.399980 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.400140 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.400313 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.400452 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.400623 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.400754 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.400930 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.401060 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.401238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.401372 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.401545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.401686 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.401854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.401985 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.402160 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.402304 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.402468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.402599 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.402771 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.402902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.403073 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.403203 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.403381 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.403514 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.403689 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.403820 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.403995 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.404138 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.404323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.404451 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.404630 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.404723 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.404941 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.405042 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.405245 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.405353 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.405551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.405643 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.405855 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.405948 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.406300 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.406731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.406731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.406908 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.407003 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.407097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.407190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.407282 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.407480 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.407582 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.407897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.408000 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.408235 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.408337 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.408552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.408697 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.408862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.408990 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.409166 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.409298 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.409490 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.409621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.409808 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.409945 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.410116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.410246 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.410440 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.410572 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.410749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.410888 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.411062 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.411210 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.411360 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.411496 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.411674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.411805 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.411986 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.412155 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.412321 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.412455 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.412629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.412758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.412934 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.413084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.413241 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.413372 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.413561 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.413691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.413873 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.414014 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.414173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.414304 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.414474 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.414613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.414779 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.414921 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.415082 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.415212 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.415382 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.415514 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.416049 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.416200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.416330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.416465 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.416640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.416771 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.416941 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.417080 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.417243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.417382 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.417546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.417677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.417848 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.417980 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.418150 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.418280 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.418451 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.418592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.418754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.418894 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.419053 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.419185 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.419354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.419494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.419654 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.419785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.419955 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.420138 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.420295 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.420474 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.420613 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.420795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.420926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.421112 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.421243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.421425 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.421556 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.421808 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 18:28:04.422331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.422331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.422591 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.422774 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.423092 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.423404 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.423717 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.424075 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.424387 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.424697 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.425004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.425311 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.425616 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.425924 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.426246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.426568 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.426872 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.427193 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.427511 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.427826 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.428173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.428486 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.428815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.429124 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.429433 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.429749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.430057 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.430364 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.430675 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.430988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.431313 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.431635 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.431943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.432480 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.432809 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.433155 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.433468 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.433819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.434148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.434466 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.434780 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.435087 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:28:04.435330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 18:28:04.481296 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO dbcounter [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Registered counter for database nova_api Jun 04 18:28:04.494306 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO dbcounter [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Registered counter for database nova_api Jun 04 18:28:04.501621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_db.sqlalchemy.engines [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:28:04.508540 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writer thread running {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:28:04.514113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_db.sqlalchemy.engines [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:28:04.520732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writer thread running {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:28:04.565118 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.context [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),06ed45c9-c444-4a55-b87d-b6450438916e(cell1) {{(pid=117731) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 18:28:04.569314 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:04.571186 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:04.572023 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:04.573989 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:04.575997 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO dbcounter [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Registered counter for database nova_cell0 Jun 04 18:28:04.577161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.context [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),06ed45c9-c444-4a55-b87d-b6450438916e(cell1) {{(pid=117732) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 18:28:04.581422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:04.581569 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO dbcounter [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Registered counter for database nova_cell1 Jun 04 18:28:04.583287 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:04.584094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:04.586080 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:04.588199 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO dbcounter [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Registered counter for database nova_cell0 Jun 04 18:28:04.590996 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_db.sqlalchemy.engines [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:28:04.592244 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_db.sqlalchemy.engines [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:28:04.594178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO dbcounter [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Registered counter for database nova_cell1 Jun 04 18:28:04.599175 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writer thread running {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:28:04.600509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writer thread running {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:28:04.601552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_db.sqlalchemy.engines [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:28:04.604175 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_db.sqlalchemy.engines [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:28:04.607963 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writer thread running {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:28:04.746965 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO dbcounter [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Registered counter for database nova_cell0 Jun 04 18:28:04.747914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writer thread running {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:28:04.754453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_db.sqlalchemy.engines [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:28:04.758786 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO dbcounter [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Registered counter for database nova_cell0 Jun 04 18:28:04.759287 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writer thread running {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:28:04.765512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_db.sqlalchemy.engines [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:28:04.772577 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writer thread running {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:28:05.194950 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: WARNING keystonemiddleware.auth_token [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 18:28:05.202397 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: WARNING keystonemiddleware.auth_token [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 18:28:05.209047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: WARNING keystonemiddleware.auth_token [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 18:28:05.216407 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: WARNING keystonemiddleware.auth_token [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 18:28:05.426846 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: WARNING keystonemiddleware.auth_token [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 18:28:05.432922 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: WARNING keystonemiddleware.auth_token [None req-c8f960b7-ac0c-4037-94bf-10f55bacf691 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 18:28:05.438324 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e3099f9c0 pid: 117731 (default app) Jun 04 18:28:05.441849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: WARNING keystonemiddleware.auth_token [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 18:28:05.447988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: WARNING keystonemiddleware.auth_token [None req-557f303c-cb16-4f5e-a913-0054f2ee62ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 18:28:05.453427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e3099f9c0 pid: 117732 (default app) Jun 04 18:28:46.885000 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:46.886511 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:46.887489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:46.888269 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.941113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.943122 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.946135 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.947577 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:48.036189 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0aa1104f-6076-493e-9225-b30cd8c85cdd tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] Action: 'create', calling method: .version_select at 0x7f467ffd0700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-269254012", "metadata": {"Type": "work"}}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:28:49.490297 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1991a65b-0dc7-4c21-97c2-19ab3374977b tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Action: 'create', calling method: .version_select at 0x7f467ffce5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1679216424"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:28:49.907743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0aa1104f-6076-493e-9225-b30cd8c85cdd tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.032322 Jun 04 18:28:49.909545 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 4 18:28:46 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3036 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 04 18:28:49.918912 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2a846e15-7f38-4a1f-98f1-811b79a7a190 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467fe9b670>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:50.058402 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2a846e15-7f38-4a1f-98f1-811b79a7a190 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7e1bf953-78e2-4d5e-8f1d-6e3b021e4f39" status: 200 len: 350 microversion: 2.1 time: 0.146511 Jun 04 18:28:50.059199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 2/2] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:49 2022] GET /compute/v2.1/os-volumes/7e1bf953-78e2-4d5e-8f1d-6e3b021e4f39 => generated 350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:50.166817 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1850337174", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "networks": [{"uuid": "c83ba8c2-8794-4951-923d-b96ecc6c9200"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:28:50.313339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] validate_networks() for [('c83ba8c2-8794-4951-923d-b96ecc6c9200', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:28:51.169375 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1991a65b-0dc7-4c21-97c2-19ab3374977b tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.235167 Jun 04 18:28:51.169926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1154 bytes} [Sat Jun 4 18:28:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3238 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 04 18:28:51.176363 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-35ee77b5-252e-4f0e-b7d4-42d772aad985 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] Calling method '.version_select at 0x7f467fe9c5e0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:51.368137 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-35ee77b5-252e-4f0e-b7d4-42d772aad985 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215" status: 200 len: 353 microversion: 2.1 time: 0.196454 Jun 04 18:28:51.368790 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:51 2022] GET /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 => generated 353 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:51.374684 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-88548188-53e7-4e04-b2b8-9d5b05191164 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fe9c670>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:51.477632 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-88548188-53e7-4e04-b2b8-9d5b05191164 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4" status: 200 len: 345 microversion: 2.1 time: 0.107548 Jun 04 18:28:51.478199 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:51 2022] GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:51.482780 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1103f80a-b647-4d69-9833-d0ded2bf4a02 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] Calling method '.version_select at 0x7f467fe9cdc0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:51.605019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1103f80a-b647-4d69-9833-d0ded2bf4a02 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215" status: 200 len: 353 microversion: 2.1 time: 0.125761 Jun 04 18:28:51.605868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 4/6] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:51 2022] GET /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:51.619536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5b3f3952-ee8c-41a4-af65-3d5e6457ca99 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] Calling method '.version_select at 0x7f467feaa4c0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:51.641423 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:28:51.642509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:28:51.643270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:28:51.643979 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:28:51.644677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:28:51.672947 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:51.678213 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:51.679273 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:51.679834 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:51.757187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Getting quotas for project 1d8e7a5f85464feeb943b5da573f0844. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:28:51.777319 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Getting quotas for user e0b3c1b83e3f46a5a2d2593191f118ec and project 1d8e7a5f85464feeb943b5da573f0844. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:28:51.780815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5b3f3952-ee8c-41a4-af65-3d5e6457ca99 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215" status: 202 len: 0 microversion: 2.1 time: 0.162226 Jun 04 18:28:51.785409 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 5/7] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:28:51 2022] DELETE /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 18:28:51.799644 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3a7deb21-db3b-478b-accd-768766e8a6e2 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] Calling method '.version_select at 0x7f467fe9cca0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:51.816102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:28:51.819149 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:28:51.900737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3a7deb21-db3b-478b-accd-768766e8a6e2 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215" status: 200 len: 352 microversion: 2.1 time: 0.113795 Jun 04 18:28:51.909210 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 6/8] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:51 2022] GET /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:52.033134 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3ca03b40-b31e-4bb1-96df-21f65e897454 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.965854 Jun 04 18:28:52.033961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 3/9] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:28:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:28:52.048552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9ad5ec53-3e3e-484f-94ad-3139e53f9111 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:52.049622 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9ad5ec53-3e3e-484f-94ad-3139e53f9111 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:28:52.235060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9ad5ec53-3e3e-484f-94ad-3139e53f9111 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:28:52.255097 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9ad5ec53-3e3e-484f-94ad-3139e53f9111 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1215 microversion: 2.1 time: 0.213275 Jun 04 18:28:52.270880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 7/10] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:28:52 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1215 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:28:52.375592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-de3aecd8-020f-4473-b1b3-1a29aea82f42 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467fdc0310>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:52.495478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c342fcd7-89b2-4b1e-8d84-f3b0b1cae272 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fe6d0d0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:52.504130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-de3aecd8-020f-4473-b1b3-1a29aea82f42 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/58807260-0d63-4944-b77d-97c01dcb3eb9" status: 200 len: 350 microversion: 2.1 time: 0.134874 Jun 04 18:28:52.505060 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 4/11] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:52 2022] GET /compute/v2.1/os-volumes/58807260-0d63-4944-b77d-97c01dcb3eb9 => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:52.575764 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c342fcd7-89b2-4b1e-8d84-f3b0b1cae272 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4" status: 200 len: 346 microversion: 2.1 time: 0.088151 Jun 04 18:28:52.577510 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 8/12] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:52 2022] GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:28:52.593259 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-01d874d2-6452-4446-9ee0-87e1c2d8fff6 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Action: 'create', calling method: .version_select at 0x7f467fdc09d0>, body: {"snapshot": {"volume_id": "d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-756935742"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:28:52.915824 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-685acb25-c01e-41c2-906c-2a053236d0f9 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] Calling method '.version_select at 0x7f467fe6a4c0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:53.154514 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-685acb25-c01e-41c2-906c-2a053236d0f9 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] HTTP exception thrown: Volume a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 could not be found. Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-685acb25-c01e-41c2-906c-2a053236d0f9 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] Request method failure captured: Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 HTTP/1.1 Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6ReKWqIddfQP2n2OiwnfwVSdbv6QZClro819ZHj-JB9vGdZPz_-WZbsSeeB7rT5IvWp1GZix9jG1kixl_T2gsssLODEs1ZudLpNoz2twmhoglOPjXfOOnatlTmGVfWF6COJzU_ZA5MDxFAqDdu1qIpK7MmC77yopV6Q3SxpYXIDGOk Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 9702c61600da49e29c12cbedfaf40308 Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesGetTestJSON-538175850 Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:28:53.164520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9702c61600da49e29c12cbedfaf40308"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9702c61600da49e29c12cbedfaf40308"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9702c61600da49e29c12cbedfaf40308"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9702c61600da49e29c12cbedfaf40308"}]}] Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesGetTestJSON-538175850 Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 9702c61600da49e29c12cbedfaf40308 Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesGetTestJSON-538175850 Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesGetTestJSON-538175850-project Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5ea5abd67bcb4818a5f601561039522d Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesGetTestJSON-538175850-project Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Volume a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 could not be found. Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'a6bfd9db-fb0e-4d0f-ae2b-99f31716e215'} Jun 04 18:28:53.165897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 could not be found. (HTTP 404) (Request-ID: req-7943d41f-8599-428b-9537-c076593816db) Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:53.166508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:28:53.167319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 could not be found. Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 18:28:53.168224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 could not be found. Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 could not be found. Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:53.169127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-685acb25-c01e-41c2-906c-2a053236d0f9 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] Returning 404 to user: Volume a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:28:53.172140 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-685acb25-c01e-41c2-906c-2a053236d0f9 tempest-VolumesGetTestJSON-538175850 tempest-VolumesGetTestJSON-538175850-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215" status: 404 len: 109 microversion: 2.1 time: 0.257496 Jun 04 18:28:53.172140 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 9/13] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:52 2022] GET /compute/v2.1/os-volumes/a6bfd9db-fb0e-4d0f-ae2b-99f31716e215 => generated 109 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:28:53.216726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-01d874d2-6452-4446-9ee0-87e1c2d8fff6 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.629170 Jun 04 18:28:53.217623 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 5/14] 10.222.0.39 () {60 vars in 1161 bytes} [Sat Jun 4 18:28:52 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:53.228295 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ad556c80-24f7-41ea-96f4-25847bdd6c67 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fde64c0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:53.272416 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-34dc425b-abe6-4822-ab8c-3d56e9f6312a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:53.273044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-34dc425b-abe6-4822-ab8c-3d56e9f6312a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:28:53.589200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ad556c80-24f7-41ea-96f4-25847bdd6c67 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.365284 Jun 04 18:28:53.595243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 10/15] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:28:53 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:53.600701 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-33c021f2-6d73-49c5-af8e-21ef31044de5 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fde6b80>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:53.647845 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-34dc425b-abe6-4822-ab8c-3d56e9f6312a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:28:53.694736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-34dc425b-abe6-4822-ab8c-3d56e9f6312a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1215 microversion: 2.1 time: 0.425288 Jun 04 18:28:53.699218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 6/16] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:28:53 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1215 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:28:54.214195 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-33c021f2-6d73-49c5-af8e-21ef31044de5 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.617595 Jun 04 18:28:54.215610 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 11/17] 10.222.0.39 () {58 vars in 1139 bytes} [Sat Jun 4 18:28:53 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:54.226392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d9476050-a72d-4dd2-ab4c-3c800ad46b2d tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467ed4d790>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:54.329079 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d9476050-a72d-4dd2-ab4c-3c800ad46b2d tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.106949 Jun 04 18:28:54.329659 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 7/18] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:28:54 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:54.442657 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7b9b4611-3a3a-4ada-9867-58fd2da89846 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467fde6f70>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:54.543985 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7b9b4611-3a3a-4ada-9867-58fd2da89846 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/862ba6fb-a089-4191-9b83-8f2408bb17bd" status: 200 len: 350 microversion: 2.1 time: 0.109311 Jun 04 18:28:54.544921 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 12/19] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:54 2022] GET /compute/v2.1/os-volumes/862ba6fb-a089-4191-9b83-8f2408bb17bd => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:54.561830 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8e014dae-efce-4770-8ed3-55e27304fe8c tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467ed69790>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:54.716201 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-96db8b24-6dd2-45a8-a9d3-bca085e45c8f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:54.716977 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-96db8b24-6dd2-45a8-a9d3-bca085e45c8f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:28:54.738368 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96db8b24-6dd2-45a8-a9d3-bca085e45c8f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:54.748867 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96db8b24-6dd2-45a8-a9d3-bca085e45c8f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:54.749936 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96db8b24-6dd2-45a8-a9d3-bca085e45c8f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:54.750508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96db8b24-6dd2-45a8-a9d3-bca085e45c8f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:54.815777 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8e014dae-efce-4770-8ed3-55e27304fe8c tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.262656 Jun 04 18:28:54.816418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 8/20] 10.222.0.39 () {58 vars in 1133 bytes} [Sat Jun 4 18:28:54 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:28:54.829130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6c164e03-c8f2-4f54-ac68-06a0fa55bbf3 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467ed6f430>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:54.964080 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6c164e03-c8f2-4f54-ac68-06a0fa55bbf3 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.138702 Jun 04 18:28:54.964999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 9/21] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 4 18:28:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:54.977321 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-94c5fb22-4a10-4dc9-8936-4d4700bd02c2 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467ed69af0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:55.084837 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-96db8b24-6dd2-45a8-a9d3-bca085e45c8f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:28:55.099497 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-96db8b24-6dd2-45a8-a9d3-bca085e45c8f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1219 microversion: 2.1 time: 0.390606 Jun 04 18:28:55.106269 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 13/22] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:28:54 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1219 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:28:55.144937 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-94c5fb22-4a10-4dc9-8936-4d4700bd02c2 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.171450 Jun 04 18:28:55.146022 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 10/23] 10.222.0.39 () {58 vars in 1133 bytes} [Sat Jun 4 18:28:54 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:28:55.159511 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8b09de1e-17b5-44c7-baad-3852b5cf2359 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467fd5dc10>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:55.273386 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8b09de1e-17b5-44c7-baad-3852b5cf2359 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.118646 Jun 04 18:28:55.274065 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 14/24] 10.222.0.39 () {58 vars in 1166 bytes} [Sat Jun 4 18:28:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:55.287260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5352f415-1a57-4c09-b0b5-48639e59f246 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467ed6f670>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:55.341471 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b30d2b5a-cc0b-4726-81b6-95445589051b tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fd63af0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:55.418071 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5352f415-1a57-4c09-b0b5-48639e59f246 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.134576 Jun 04 18:28:55.427888 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 11/25] 10.222.0.39 () {58 vars in 1169 bytes} [Sat Jun 4 18:28:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:55.432922 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-95e4a152-29f4-43db-8a0a-fe8a1fd8df12 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467ed76280>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:55.501641 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b30d2b5a-cc0b-4726-81b6-95445589051b tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.164283 Jun 04 18:28:55.503532 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 15/26] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:28:55 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:55.622084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-95e4a152-29f4-43db-8a0a-fe8a1fd8df12 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.186684 Jun 04 18:28:55.623098 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 12/27] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 4 18:28:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:28:55.634789 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-85f27147-54f7-4195-9e42-f52809cc3e4c tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467fd63a60>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:55.782062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-85f27147-54f7-4195-9e42-f52809cc3e4c tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.151507 Jun 04 18:28:55.784185 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 16/28] 10.222.0.39 () {58 vars in 1187 bytes} [Sat Jun 4 18:28:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:55.795174 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5fa048cb-37f4-4768-b5b5-0a1389afb233 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] Calling method '.version_select at 0x7f467ed6f3a0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:55.960301 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5fa048cb-37f4-4768-b5b5-0a1389afb233 tempest-VolumesTestJSON-231503084 tempest-VolumesTestJSON-231503084-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.169040 Jun 04 18:28:55.972367 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 13/29] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 4 18:28:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:28:56.122871 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ac65551c-6e56-459f-bd52-b897e26b706a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:56.123545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ac65551c-6e56-459f-bd52-b897e26b706a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:28:56.133644 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ac65551c-6e56-459f-bd52-b897e26b706a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:56.134104 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ac65551c-6e56-459f-bd52-b897e26b706a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:56.134878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ac65551c-6e56-459f-bd52-b897e26b706a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:56.139122 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ac65551c-6e56-459f-bd52-b897e26b706a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:56.309641 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ac65551c-6e56-459f-bd52-b897e26b706a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:28:56.321085 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ac65551c-6e56-459f-bd52-b897e26b706a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1219 microversion: 2.1 time: 0.200754 Jun 04 18:28:56.322770 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 17/30] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:28:56 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1219 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:28:56.515072 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3fc8af7f-c862-47a4-ba8a-d509654351f0 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fd634c0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:56.607254 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3fc8af7f-c862-47a4-ba8a-d509654351f0 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.095958 Jun 04 18:28:56.612462 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 18/31] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:28:56 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:28:56.684865 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-24480a6f-4326-45b8-84b6-969e375f2431 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Action: 'create', calling method: .version_select at 0x7f4680880820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1289784196", "metadata": {"Type": "work"}}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-24480a6f-4326-45b8-84b6-969e375f2431 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Request method failure captured: Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 122 Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6RodEgxjbMhOu0ZJQLzPLMKKvsKmsk9FfCyq_tTzLq-tNEWufdlO6R7_2rx4euemwOUTS_kdB_RupBWJauUz9kCBg_qZA9UQ3OMA8uJmf8bdnDIXyPKAXpHyD1lx5AqWsD5vcwjkYyyV4VB_RNwZ0lSQdMMT1lPJXIxMhI3aP7RmW4 Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:28:56.707691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}] Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 0383457f6d3c4a89b75f724102c0039b Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1289784196", "metadata": {"Type": "work"}}} Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: Jun 04 18:28:56.709097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1289784196', 'metadata': {'Type': 'work'}}}} Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise error Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi '#$%' Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:28:56.709859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 18:28:56.711084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 18:28:56.712228 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 04 18:28:56.712228 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.713305 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-24480a6f-4326-45b8-84b6-969e375f2431 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:28:56.714326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-24480a6f-4326-45b8-84b6-969e375f2431 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.313482 Jun 04 18:28:56.715051 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 14/32] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 4 18:28:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:28:56.726130 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-06fc2b02-f64d-4c06-aacc-53e6a76f7049 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Action: 'create', calling method: .version_select at 0x7f467fd63550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2018895847", "metadata": {"Type": "work"}}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-06fc2b02-f64d-4c06-aacc-53e6a76f7049 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Request method failure captured: Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 120 Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6RodEgxjbMhOu0ZJQLzPLMKKvsKmsk9FfCyq_tTzLq-tNEWufdlO6R7_2rx4euemwOUTS_kdB_RupBWJauUz9kCBg_qZA9UQ3OMA8uJmf8bdnDIXyPKAXpHyD1lx5AqWsD5vcwjkYyyV4VB_RNwZ0lSQdMMT1lPJXIxMhI3aP7RmW4 Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:28:56.730749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}] Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 0383457f6d3c4a89b75f724102c0039b Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2018895847", "metadata": {"Type": "work"}}} Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: Jun 04 18:28:56.732060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2018895847', 'metadata': {'Type': 'work'}}}} Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise error Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi '0' Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:28:56.733043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 18:28:56.735004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 18:28:56.740863 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 04 18:28:56.740863 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.740863 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-06fc2b02-f64d-4c06-aacc-53e6a76f7049 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:28:56.740863 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-06fc2b02-f64d-4c06-aacc-53e6a76f7049 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011292 Jun 04 18:28:56.740863 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 19/33] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 4 18:28:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:28:56.746448 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-71c1426c-cd68-4cbb-b179-8f4b5180ef47 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Action: 'create', calling method: .version_select at 0x7f467ed695e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1700375573", "metadata": {"Type": "work"}}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-71c1426c-cd68-4cbb-b179-8f4b5180ef47 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Request method failure captured: Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 119 Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6RodEgxjbMhOu0ZJQLzPLMKKvsKmsk9FfCyq_tTzLq-tNEWufdlO6R7_2rx4euemwOUTS_kdB_RupBWJauUz9kCBg_qZA9UQ3OMA8uJmf8bdnDIXyPKAXpHyD1lx5AqWsD5vcwjkYyyV4VB_RNwZ0lSQdMMT1lPJXIxMhI3aP7RmW4 Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:28:56.749050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}] Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 0383457f6d3c4a89b75f724102c0039b Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1700375573", "metadata": {"Type": "work"}}} Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: Jun 04 18:28:56.750303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1700375573', 'metadata': {'Type': 'work'}}}} Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise error Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi '' Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:28:56.751132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 18:28:56.756768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 18:28:56.757649 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 04 18:28:56.757649 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.757649 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-71c1426c-cd68-4cbb-b179-8f4b5180ef47 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:28:56.757649 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-71c1426c-cd68-4cbb-b179-8f4b5180ef47 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010173 Jun 04 18:28:56.757649 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 15/34] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 4 18:28:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:28:56.764162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d63b169-3021-404b-802c-ccf9a64e867c tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Calling method '.version_select at 0x7f467fd68af0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:56.799428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-7d63b169-3021-404b-802c-ccf9a64e867c tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] HTTP exception thrown: Volume tempest-invalid-110381026 could not be found. Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d63b169-3021-404b-802c-ccf9a64e867c tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Request method failure captured: Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-110381026 HTTP/1.1 Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6RodEgxjbMhOu0ZJQLzPLMKKvsKmsk9FfCyq_tTzLq-tNEWufdlO6R7_2rx4euemwOUTS_kdB_RupBWJauUz9kCBg_qZA9UQ3OMA8uJmf8bdnDIXyPKAXpHyD1lx5AqWsD5vcwjkYyyV4VB_RNwZ0lSQdMMT1lPJXIxMhI3aP7RmW4 Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:28:56.801380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}] Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 0383457f6d3c4a89b75f724102c0039b Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Volume tempest-invalid-110381026 could not be found. Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'tempest-invalid-110381026'} Jun 04 18:28:56.802640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-110381026 could not be found. (HTTP 404) (Request-ID: req-dc965958-dcb3-4280-80dd-e1af157bb5f6) Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.803308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 18:28:56.808541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-110381026 could not be found. Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:28:56.809690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-110381026 could not be found. Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-110381026 could not be found. Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d63b169-3021-404b-802c-ccf9a64e867c tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Returning 404 to user: Volume tempest-invalid-110381026 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7d63b169-3021-404b-802c-ccf9a64e867c tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-110381026" status: 404 len: 98 microversion: 2.1 time: 0.044474 Jun 04 18:28:56.810833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 20/35] 10.222.0.39 () {58 vars in 1214 bytes} [Sat Jun 4 18:28:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-110381026 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 18:28:56.813980 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-aa3b9727-6812-4ab9-8138-6e7f3fc1de84 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004120 Jun 04 18:28:56.818305 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 16/36] 10.222.0.39 () {58 vars in 1139 bytes} [Sat Jun 4 18:28:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 04 18:28:56.826698 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6db2f335-09d2-44a2-a2ef-14783db737b8 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005355 Jun 04 18:28:56.828182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 21/37] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 4 18:28:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 04 18:28:56.836867 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fbb3eb66-3a9b-44ac-8f99-bca50483cb62 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Calling method '.version_select at 0x7f467ed6f4c0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:56.876834 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-fbb3eb66-3a9b-44ac-8f99-bca50483cb62 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] HTTP exception thrown: Volume 94a736dd-3668-4df7-9d93-f3988883a20e could not be found. Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fbb3eb66-3a9b-44ac-8f99-bca50483cb62 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Request method failure captured: Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/os-volumes/94a736dd-3668-4df7-9d93-f3988883a20e HTTP/1.1 Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6RodEgxjbMhOu0ZJQLzPLMKKvsKmsk9FfCyq_tTzLq-tNEWufdlO6R7_2rx4euemwOUTS_kdB_RupBWJauUz9kCBg_qZA9UQ3OMA8uJmf8bdnDIXyPKAXpHyD1lx5AqWsD5vcwjkYyyV4VB_RNwZ0lSQdMMT1lPJXIxMhI3aP7RmW4 Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:28:56.882253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}] Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 0383457f6d3c4a89b75f724102c0039b Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Volume 94a736dd-3668-4df7-9d93-f3988883a20e could not be found. Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '94a736dd-3668-4df7-9d93-f3988883a20e'} Jun 04 18:28:56.883789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94a736dd-3668-4df7-9d93-f3988883a20e could not be found. (HTTP 404) (Request-ID: req-695b0eb0-19b3-4881-beec-f0d163e710cd) Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.884613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 18:28:56.885700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94a736dd-3668-4df7-9d93-f3988883a20e could not be found. Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 04 18:28:56.886762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94a736dd-3668-4df7-9d93-f3988883a20e could not be found. Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94a736dd-3668-4df7-9d93-f3988883a20e could not be found. Jun 04 18:28:56.887844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.889770 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fbb3eb66-3a9b-44ac-8f99-bca50483cb62 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Returning 404 to user: Volume 94a736dd-3668-4df7-9d93-f3988883a20e could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:28:56.891087 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fbb3eb66-3a9b-44ac-8f99-bca50483cb62 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/94a736dd-3668-4df7-9d93-f3988883a20e" status: 404 len: 109 microversion: 2.1 time: 0.056552 Jun 04 18:28:56.892203 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 17/38] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:28:56 2022] DELETE /compute/v2.1/os-volumes/94a736dd-3668-4df7-9d93-f3988883a20e => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 18:28:56.900854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6a3be05e-c912-4b3f-9ba3-9fa968e7c0a3 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Calling method '.version_select at 0x7f467fd63790>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:56.936575 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-6a3be05e-c912-4b3f-9ba3-9fa968e7c0a3 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] HTTP exception thrown: Volume 5f3d63ef-509a-4741-b347-45d9b1047613 could not be found. Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6a3be05e-c912-4b3f-9ba3-9fa968e7c0a3 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Request method failure captured: Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/os-volumes/5f3d63ef-509a-4741-b347-45d9b1047613 HTTP/1.1 Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6RodEgxjbMhOu0ZJQLzPLMKKvsKmsk9FfCyq_tTzLq-tNEWufdlO6R7_2rx4euemwOUTS_kdB_RupBWJauUz9kCBg_qZA9UQ3OMA8uJmf8bdnDIXyPKAXpHyD1lx5AqWsD5vcwjkYyyV4VB_RNwZ0lSQdMMT1lPJXIxMhI3aP7RmW4 Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:28:56.938713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca7b778257c346e083645d41a3eb8732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca7b778257c346e083645d41a3eb8732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca7b778257c346e083645d41a3eb8732"}]}] Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: ca7b778257c346e083645d41a3eb8732 Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesNegativeTest-111111286 Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 0383457f6d3c4a89b75f724102c0039b Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesNegativeTest-111111286-project Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Volume 5f3d63ef-509a-4741-b347-45d9b1047613 could not be found. Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '5f3d63ef-509a-4741-b347-45d9b1047613'} Jun 04 18:28:56.939772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f3d63ef-509a-4741-b347-45d9b1047613 could not be found. (HTTP 404) (Request-ID: req-436bc2aa-c4cf-4d90-922b-01d8175bf7ca) Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.940560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:28:56.941549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f3d63ef-509a-4741-b347-45d9b1047613 could not be found. Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 18:28:56.942397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f3d63ef-509a-4741-b347-45d9b1047613 could not be found. Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f3d63ef-509a-4741-b347-45d9b1047613 could not be found. Jun 04 18:28:56.943351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:28:56.944848 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6a3be05e-c912-4b3f-9ba3-9fa968e7c0a3 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] Returning 404 to user: Volume 5f3d63ef-509a-4741-b347-45d9b1047613 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:28:56.945898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6a3be05e-c912-4b3f-9ba3-9fa968e7c0a3 tempest-VolumesNegativeTest-111111286 tempest-VolumesNegativeTest-111111286-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5f3d63ef-509a-4741-b347-45d9b1047613" status: 404 len: 109 microversion: 2.1 time: 0.048916 Jun 04 18:28:56.946582 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 22/39] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:28:56 2022] GET /compute/v2.1/os-volumes/5f3d63ef-509a-4741-b347-45d9b1047613 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:28:57.349216 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-415e68f3-6ebc-49aa-980f-f5db7405bf82 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:57.349858 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-415e68f3-6ebc-49aa-980f-f5db7405bf82 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:28:57.362864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-415e68f3-6ebc-49aa-980f-f5db7405bf82 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:57.363564 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-415e68f3-6ebc-49aa-980f-f5db7405bf82 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:57.368382 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-415e68f3-6ebc-49aa-980f-f5db7405bf82 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:57.368908 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-415e68f3-6ebc-49aa-980f-f5db7405bf82 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:57.619787 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ddc6af64-ade9-4af2-af88-a6c3ae520447 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fd5d9d0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:57.635216 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-415e68f3-6ebc-49aa-980f-f5db7405bf82 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:28:57.674520 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-415e68f3-6ebc-49aa-980f-f5db7405bf82 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1219 microversion: 2.1 time: 0.334506 Jun 04 18:28:57.689703 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 18/40] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:28:57 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1219 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:28:57.718479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ddc6af64-ade9-4af2-af88-a6c3ae520447 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.102061 Jun 04 18:28:57.726539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 23/41] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:28:57 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:58.695689 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9da09d66-045d-4022-b7fb-dc7d214b18ee tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:58.697067 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9da09d66-045d-4022-b7fb-dc7d214b18ee tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:28:58.713602 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9da09d66-045d-4022-b7fb-dc7d214b18ee tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:58.719974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9da09d66-045d-4022-b7fb-dc7d214b18ee tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:58.720952 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9da09d66-045d-4022-b7fb-dc7d214b18ee tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:28:58.721428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9da09d66-045d-4022-b7fb-dc7d214b18ee tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:28:58.729595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2e80af8a-f35a-43bf-9f5c-9495ebaeb374 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'create', calling method: .version_select at 0x7f467ed6fc10>, body: {"keypair": {"name": "tempest-keypair-566453212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHG44LgmNqxyJODw+MifA71PTGlxIlo/wLztC8p0BuSb7Y3QI6H/5Wpv40OgIe4zfrXRW0DUXOZZ0CAzysiP8pF/ZcTj+kzpBo06haolvlVM579ehL1tuwZrN7yc7XMMxw=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:28:58.803062 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-2e80af8a-f35a-43bf-9f5c-9495ebaeb374 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Getting quotas for project 4a74defc69084b06b8d6300d1ce15bc5. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:28:58.822559 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-2e80af8a-f35a-43bf-9f5c-9495ebaeb374 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Getting quotas for user bbb6c8f984d645dda88e2744f62a5213 and project 4a74defc69084b06b8d6300d1ce15bc5. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:28:58.883682 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2e80af8a-f35a-43bf-9f5c-9495ebaeb374 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.379522 Jun 04 18:28:58.884664 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 19/42] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:28:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:58.891442 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ca97288c-e019-4659-b60c-9f46909e4355 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467ec75700>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:28:58.949318 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ca97288c-e019-4659-b60c-9f46909e4355 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.063440 Jun 04 18:28:58.950043 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 20/43] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:28:58 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:28:59.164587 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9da09d66-045d-4022-b7fb-dc7d214b18ee tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:28:59.191330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9da09d66-045d-4022-b7fb-dc7d214b18ee tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1219 microversion: 2.1 time: 0.502259 Jun 04 18:28:59.203663 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 24/44] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:28:58 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1219 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:28:59.674137 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1013545435", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:28:59.779022 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] validate_networks() for [('c9b1af56-bcdd-404d-8bc1-4951853f69e2', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:28:59.961152 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ba046307-571c-4fba-802d-20e9c26290bc tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fd0bd30>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:00.018860 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ba046307-571c-4fba-802d-20e9c26290bc tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 287 microversion: 2.1 time: 0.061459 Jun 04 18:29:00.019433 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 25/45] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:28:59 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:29:00.030618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f8e6831d-cc3c-4323-a11d-6f540a92a2d0 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fde6310>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:00.124629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f8e6831d-cc3c-4323-a11d-6f540a92a2d0 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 202 len: 0 microversion: 2.1 time: 0.098649 Jun 04 18:29:00.125734 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 26/46] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 4 18:29:00 2022] DELETE /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:29:00.134478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5a34c218-a527-4e71-9903-15f50b4d3b73 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467fd638b0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:00.203724 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5a34c218-a527-4e71-9903-15f50b4d3b73 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.073505 Jun 04 18:29:00.204311 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 27/47] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:29:00 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:29:00.212461 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0b6b1935-0cb2-4c1e-b6ca-d9ccdf23aba8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:00.213114 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0b6b1935-0cb2-4c1e-b6ca-d9ccdf23aba8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:00.228121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b6b1935-0cb2-4c1e-b6ca-d9ccdf23aba8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:00.229080 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b6b1935-0cb2-4c1e-b6ca-d9ccdf23aba8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:00.230132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b6b1935-0cb2-4c1e-b6ca-d9ccdf23aba8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:00.230881 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b6b1935-0cb2-4c1e-b6ca-d9ccdf23aba8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:00.392321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0b6b1935-0cb2-4c1e-b6ca-d9ccdf23aba8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:00.408561 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0b6b1935-0cb2-4c1e-b6ca-d9ccdf23aba8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1267 microversion: 2.1 time: 0.201455 Jun 04 18:29:00.418867 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 28/48] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:00 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:00.889165 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:29:00.889763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:29:00.890233 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:29:00.890648 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:29:00.891063 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:29:00.907153 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:00.907606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:00.908428 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:00.908856 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:00.943789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Getting quotas for project a3c5011d10ed45c68dcfe77a09f6d9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:29:00.948709 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Getting quotas for user 30f3cc8f3f964b96b864fc8a7f86481a and project a3c5011d10ed45c68dcfe77a09f6d9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:29:00.961835 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:29:00.964509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:29:01.038206 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6c628fd3-3d81-41c8-b378-751e3b330bb0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.861477 Jun 04 18:29:01.042406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 21/49] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:28:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:29:01.051802 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-af298614-60e2-4c1f-8974-82517d152f1a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:01.052336 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-af298614-60e2-4c1f-8974-82517d152f1a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:01.195338 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-af298614-60e2-4c1f-8974-82517d152f1a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:01.202702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-af298614-60e2-4c1f-8974-82517d152f1a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1222 microversion: 2.1 time: 0.154608 Jun 04 18:29:01.203290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 29/50] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:01 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:01.217875 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-58064c8c-f528-446d-b993-a2c8601d3420 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467ec05160>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:01.296588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-58064c8c-f528-446d-b993-a2c8601d3420 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.083628 Jun 04 18:29:01.297263 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 22/51] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:29:01 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:01.426513 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8b3997a3-29ee-41b6-935d-73adce51e315 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:01.426970 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1664581916", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:01.427127 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8b3997a3-29ee-41b6-935d-73adce51e315 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:01.441482 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b3997a3-29ee-41b6-935d-73adce51e315 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:01.442173 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b3997a3-29ee-41b6-935d-73adce51e315 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:01.443100 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b3997a3-29ee-41b6-935d-73adce51e315 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:01.443677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b3997a3-29ee-41b6-935d-73adce51e315 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:01.556852 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8b3997a3-29ee-41b6-935d-73adce51e315 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:01.587588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8b3997a3-29ee-41b6-935d-73adce51e315 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1267 microversion: 2.1 time: 0.163169 Jun 04 18:29:01.588808 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 23/52] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:01 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:01.682641 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] validate_networks() for [('c9b1af56-bcdd-404d-8bc1-4951853f69e2', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:29:02.316453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1cae8570-c575-481d-8a0c-49bf03973ce0 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467ec1faf0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:02.425785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1cae8570-c575-481d-8a0c-49bf03973ce0 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.120676 Jun 04 18:29:02.426512 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 24/53] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:29:02 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:02.539126 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-539667733", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc7986cb-2ff2-4f08-a9be-30c9595330e4"}], "security_groups": [{"name": "tempest-securitygroup--2070454149"}], "key_name": "tempest-keypair-566453212", "user_data": "}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:02.836446 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] validate_networks() for [('dc7986cb-2ff2-4f08-a9be-30c9595330e4', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:29:02.970846 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:29:02.971471 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:29:02.971889 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:29:02.972911 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:29:02.973595 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:29:02.992569 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:02.993177 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:02.994594 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:02.995173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:03.038224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Getting quotas for project a3c5011d10ed45c68dcfe77a09f6d9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:29:03.050822 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Getting quotas for user 30f3cc8f3f964b96b864fc8a7f86481a and project a3c5011d10ed45c68dcfe77a09f6d9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:29:03.064708 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:29:03.073886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:29:03.221387 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6203c6cd-010e-4695-ba41-f63c926bd61e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.801276 Jun 04 18:29:03.222792 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 30/54] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:29:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:29:03.234537 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a66a483e-f8cb-4ab1-855b-938a8657c8d7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:03.235433 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a66a483e-f8cb-4ab1-855b-938a8657c8d7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:03.249371 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a66a483e-f8cb-4ab1-855b-938a8657c8d7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:03.250063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a66a483e-f8cb-4ab1-855b-938a8657c8d7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:03.250999 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a66a483e-f8cb-4ab1-855b-938a8657c8d7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:03.251580 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a66a483e-f8cb-4ab1-855b-938a8657c8d7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:03.364072 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a66a483e-f8cb-4ab1-855b-938a8657c8d7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:03.375844 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a66a483e-f8cb-4ab1-855b-938a8657c8d7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1267 microversion: 2.1 time: 0.151554 Jun 04 18:29:03.388695 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 31/55] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:03 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:03.395834 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3a54fecd-770c-460f-9f2b-cc292d57267b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:03.399666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3a54fecd-770c-460f-9f2b-cc292d57267b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:03.507424 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3a54fecd-770c-460f-9f2b-cc292d57267b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:03.517537 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3a54fecd-770c-460f-9f2b-cc292d57267b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1222 microversion: 2.1 time: 0.127504 Jun 04 18:29:03.518633 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 32/56] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:03 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:03.530339 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-aa6fe76d-e791-49d5-b1b0-cf94ab99ec25 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467f41e310>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:03.588626 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-aa6fe76d-e791-49d5-b1b0-cf94ab99ec25 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 200 len: 286 microversion: 2.1 time: 0.068606 Jun 04 18:29:03.589310 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 33/57] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:29:03 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:04.397480 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9c2b442d-fe05-4f58-9360-4cd646bbafaa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:04.398154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9c2b442d-fe05-4f58-9360-4cd646bbafaa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:04.427260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c2b442d-fe05-4f58-9360-4cd646bbafaa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:04.427727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c2b442d-fe05-4f58-9360-4cd646bbafaa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:04.428560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c2b442d-fe05-4f58-9360-4cd646bbafaa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:04.429003 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c2b442d-fe05-4f58-9360-4cd646bbafaa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:04.442277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:29:04.445069 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:29:04.445764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:29:04.447151 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:29:04.448453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:29:04.465806 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:04.466764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:04.476241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:04.480377 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:04.610517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Getting quotas for project 4a74defc69084b06b8d6300d1ce15bc5. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:29:04.627306 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Getting quotas for user bbb6c8f984d645dda88e2744f62a5213 and project 4a74defc69084b06b8d6300d1ce15bc5. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:29:04.674627 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9c2b442d-fe05-4f58-9360-4cd646bbafaa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:04.688089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9c2b442d-fe05-4f58-9360-4cd646bbafaa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1273 microversion: 2.1 time: 0.295746 Jun 04 18:29:04.690550 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 34/58] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:04 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:04.710154 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:29:04.710694 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2034aebb-6106-48d0-9f70-2c5ee0b8eacb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:04.711350 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2034aebb-6106-48d0-9f70-2c5ee0b8eacb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:04.721431 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:29:04.734266 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2034aebb-6106-48d0-9f70-2c5ee0b8eacb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:04.734750 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2034aebb-6106-48d0-9f70-2c5ee0b8eacb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:04.735536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2034aebb-6106-48d0-9f70-2c5ee0b8eacb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:04.735966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2034aebb-6106-48d0-9f70-2c5ee0b8eacb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:04.844128 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ba963957-2f10-4d9a-89df-aec780ba3bd0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.306995 Jun 04 18:29:04.852172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 25/59] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:29:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 18:29:04.862238 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-757a3808-b7bf-4eee-aaeb-e3ec10d1b497 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467e3dc0d0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:04.997586 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-757a3808-b7bf-4eee-aaeb-e3ec10d1b497 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] HTTP exception thrown: Snapshot ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 could not be found. Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-757a3808-b7bf-4eee-aaeb-e3ec10d1b497 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Request method failure captured: Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 HTTP/1.1 Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6Rfl-yp8AMpsKfXRu4zJ6SaaoSZFvAYC5Uxm3B5Is5yjzT1u2E1oG3Mk1l-z0IfpbjtJ_q0KEoUmWCubIgcVYuVVlxvf7B-xuIszDG_78VXnfovkXqiRuubp5BV3eEIxadUtqPUJCmDYLnz9s04jKp_9BJRtbRK8Lg3g-GvvfLhpSs Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: e1647c99716f4b20abf41c4e4c3ec38a Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:29:05.001241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1647c99716f4b20abf41c4e4c3ec38a"}]}] Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: e1647c99716f4b20abf41c4e4c3ec38a Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesSnapshotsTestJSON-151134326-project Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 6ea261ac820542ff8698af7a5cec8181 Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesSnapshotsTestJSON-151134326-project Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Snapshot ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 could not be found. Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1'} Jun 04 18:29:05.002339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 could not be found. (HTTP 404) (Request-ID: req-878ea8fd-a631-4433-bdf1-a7fc468988e3) Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:29:05.002999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:29:05.003841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 could not be found. Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 04 18:29:05.004853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 could not be found. Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 could not be found. Jun 04 18:29:05.005815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:29:05.011056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-757a3808-b7bf-4eee-aaeb-e3ec10d1b497 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Returning 404 to user: Snapshot ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:29:05.012168 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-757a3808-b7bf-4eee-aaeb-e3ec10d1b497 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1" status: 404 len: 111 microversion: 2.1 time: 0.158116 Jun 04 18:29:05.013100 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 26/60] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 4 18:29:04 2022] GET /compute/v2.1/os-snapshots/ba3c4e8b-8ff0-4f8b-bb78-ec290edd35f1 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:29:05.027827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7123cbc7-3ef3-4b3a-b75b-76a8f9c786b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:05.028838 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7123cbc7-3ef3-4b3a-b75b-76a8f9c786b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:05.379324 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7123cbc7-3ef3-4b3a-b75b-76a8f9c786b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:05.398863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7123cbc7-3ef3-4b3a-b75b-76a8f9c786b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1236 microversion: 2.1 time: 0.379805 Jun 04 18:29:05.403600 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 27/61] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:05 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1236 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:05.433296 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5b8a2171-5942-4ce4-9ab6-b4e936b5ba05 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467ed76820>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:05.918700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5b8a2171-5942-4ce4-9ab6-b4e936b5ba05 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4" status: 202 len: 0 microversion: 2.1 time: 0.511194 Jun 04 18:29:05.920333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 28/62] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:29:05 2022] DELETE /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:29:05.927139 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3a5add0d-c234-408e-9487-bb675b79f451 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:05.928670 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3a5add0d-c234-408e-9487-bb675b79f451 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:05.948227 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a5add0d-c234-408e-9487-bb675b79f451 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:05.951729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a5add0d-c234-408e-9487-bb675b79f451 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:05.956220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a5add0d-c234-408e-9487-bb675b79f451 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:05.958555 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a5add0d-c234-408e-9487-bb675b79f451 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:06.118197 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2034aebb-6106-48d0-9f70-2c5ee0b8eacb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:06.128636 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2034aebb-6106-48d0-9f70-2c5ee0b8eacb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1274 microversion: 2.1 time: 1.436682 Jun 04 18:29:06.135685 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 35/63] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:04 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1274 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:06.143825 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-afdc765a-9809-4cdd-8ee9-c40fb5219098 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467f441820>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:06.334679 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-afdc765a-9809-4cdd-8ee9-c40fb5219098 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] HTTP exception thrown: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-afdc765a-9809-4cdd-8ee9-c40fb5219098 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Request method failure captured: Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 HTTP/1.1 Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6Rfl-yp8AMpsKfXRu4zJ6SaaoSZFvAYC5Uxm3B5Is5yjzT1u2E1oG3Mk1l-z0IfpbjtJ_q0KEoUmWCubIgcVYuVVlxvf7B-xuIszDG_78VXnfovkXqiRuubp5BV3eEIxadUtqPUJCmDYLnz9s04jKp_9BJRtbRK8Lg3g-GvvfLhpSs Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: e1647c99716f4b20abf41c4e4c3ec38a Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:29:06.337121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1647c99716f4b20abf41c4e4c3ec38a"}]}] Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: e1647c99716f4b20abf41c4e4c3ec38a Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesSnapshotsTestJSON-151134326-project Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 6ea261ac820542ff8698af7a5cec8181 Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesSnapshotsTestJSON-151134326-project Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'd79c5ea5-e131-4089-8f3d-13aa8a1c1cb4'} Jun 04 18:29:06.338437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. (HTTP 404) (Request-ID: req-ff9c2253-d013-4302-a356-bf65508517b2) Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:06.339327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:29:06.340639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 18:29:06.341853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-afdc765a-9809-4cdd-8ee9-c40fb5219098 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Returning 404 to user: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-afdc765a-9809-4cdd-8ee9-c40fb5219098 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4" status: 404 len: 109 microversion: 2.1 time: 0.201421 Jun 04 18:29:06.343217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 36/64] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:29:06 2022] GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 => generated 109 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:29:06.354458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9046954f-7726-4c01-915e-e6bcb63b0d0f tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467f41eb80>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:06.384972 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3a5add0d-c234-408e-9487-bb675b79f451 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:06.400440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3a5add0d-c234-408e-9487-bb675b79f451 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1273 microversion: 2.1 time: 0.478535 Jun 04 18:29:06.401476 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 29/65] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:05 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1273 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:06.421643 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-922de3e4-4c50-4842-a904-a8d78bdce740 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:06.422508 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-922de3e4-4c50-4842-a904-a8d78bdce740 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:06.442526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-922de3e4-4c50-4842-a904-a8d78bdce740 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:06.444320 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-922de3e4-4c50-4842-a904-a8d78bdce740 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:06.445311 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-922de3e4-4c50-4842-a904-a8d78bdce740 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:06.446077 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-922de3e4-4c50-4842-a904-a8d78bdce740 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:06.564113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-9046954f-7726-4c01-915e-e6bcb63b0d0f tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] HTTP exception thrown: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9046954f-7726-4c01-915e-e6bcb63b0d0f tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Request method failure captured: Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 HTTP/1.1 Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6Rfl-yp8AMpsKfXRu4zJ6SaaoSZFvAYC5Uxm3B5Is5yjzT1u2E1oG3Mk1l-z0IfpbjtJ_q0KEoUmWCubIgcVYuVVlxvf7B-xuIszDG_78VXnfovkXqiRuubp5BV3eEIxadUtqPUJCmDYLnz9s04jKp_9BJRtbRK8Lg3g-GvvfLhpSs Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: e1647c99716f4b20abf41c4e4c3ec38a Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:29:06.566607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1647c99716f4b20abf41c4e4c3ec38a"}]}] Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: e1647c99716f4b20abf41c4e4c3ec38a Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesSnapshotsTestJSON-151134326-project Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 6ea261ac820542ff8698af7a5cec8181 Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesSnapshotsTestJSON-151134326-project Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'd79c5ea5-e131-4089-8f3d-13aa8a1c1cb4'} Jun 04 18:29:06.569276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. (HTTP 404) (Request-ID: req-3f020bb3-2cef-4736-aff2-66afa85360dd) Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:06.570172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 18:29:06.571252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 04 18:29:06.572962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9046954f-7726-4c01-915e-e6bcb63b0d0f tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Returning 404 to user: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9046954f-7726-4c01-915e-e6bcb63b0d0f tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4" status: 404 len: 109 microversion: 2.1 time: 0.218687 Jun 04 18:29:06.575605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 37/66] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:29:06 2022] DELETE /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 => generated 109 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 18:29:06.587609 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-395cc78a-5ac4-4b71-9667-feaa574161c2 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Calling method '.version_select at 0x7f467f41ed30>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:06.737611 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-395cc78a-5ac4-4b71-9667-feaa574161c2 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] HTTP exception thrown: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-395cc78a-5ac4-4b71-9667-feaa574161c2 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Request method failure captured: Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 HTTP/1.1 Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6Rfl-yp8AMpsKfXRu4zJ6SaaoSZFvAYC5Uxm3B5Is5yjzT1u2E1oG3Mk1l-z0IfpbjtJ_q0KEoUmWCubIgcVYuVVlxvf7B-xuIszDG_78VXnfovkXqiRuubp5BV3eEIxadUtqPUJCmDYLnz9s04jKp_9BJRtbRK8Lg3g-GvvfLhpSs Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: e1647c99716f4b20abf41c4e4c3ec38a Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:29:06.740000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e1647c99716f4b20abf41c4e4c3ec38a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1647c99716f4b20abf41c4e4c3ec38a"}]}] Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: e1647c99716f4b20abf41c4e4c3ec38a Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-151134326 Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesSnapshotsTestJSON-151134326-project Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 6ea261ac820542ff8698af7a5cec8181 Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesSnapshotsTestJSON-151134326-project Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'd79c5ea5-e131-4089-8f3d-13aa8a1c1cb4'} Jun 04 18:29:06.741237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. (HTTP 404) (Request-ID: req-f0ac6800-5d5e-414c-9aed-3717b78ea36f) Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:06.741908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 18:29:06.742870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 18:29:06.744886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-395cc78a-5ac4-4b71-9667-feaa574161c2 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] Returning 404 to user: Volume d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-395cc78a-5ac4-4b71-9667-feaa574161c2 tempest-VolumesSnapshotsTestJSON-151134326 tempest-VolumesSnapshotsTestJSON-151134326-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4" status: 404 len: 109 microversion: 2.1 time: 0.168365 Jun 04 18:29:06.747274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 38/67] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:29:06 2022] GET /compute/v2.1/os-volumes/d79c5ea5-e131-4089-8f3d-13aa8a1c1cb4 => generated 109 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:29:06.757479 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-922de3e4-4c50-4842-a904-a8d78bdce740 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:06.771209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-922de3e4-4c50-4842-a904-a8d78bdce740 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1232 microversion: 2.1 time: 0.351949 Jun 04 18:29:06.771489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 30/68] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:06 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1232 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:07.164276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ff6f4e77-d56a-4146-bab9-cfd248c20999 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:07.164911 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ff6f4e77-d56a-4146-bab9-cfd248c20999 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:07.181803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ff6f4e77-d56a-4146-bab9-cfd248c20999 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:07.183993 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ff6f4e77-d56a-4146-bab9-cfd248c20999 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:07.187478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ff6f4e77-d56a-4146-bab9-cfd248c20999 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:07.190392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ff6f4e77-d56a-4146-bab9-cfd248c20999 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:07.419513 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f2a208b2-df9d-4aec-be98-2fac941809cd tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:07.420351 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f2a208b2-df9d-4aec-be98-2fac941809cd tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:07.427018 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ff6f4e77-d56a-4146-bab9-cfd248c20999 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:07.429417 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f2a208b2-df9d-4aec-be98-2fac941809cd tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:07.429852 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f2a208b2-df9d-4aec-be98-2fac941809cd tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:07.436061 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f2a208b2-df9d-4aec-be98-2fac941809cd tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:07.436799 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f2a208b2-df9d-4aec-be98-2fac941809cd tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:07.439850 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ff6f4e77-d56a-4146-bab9-cfd248c20999 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1280 microversion: 2.1 time: 0.287728 Jun 04 18:29:07.451164 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 39/69] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:07 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1280 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:07.791111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-716380e8-54b0-40af-a73b-3bce680a7112 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:07.791829 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-716380e8-54b0-40af-a73b-3bce680a7112 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:07.805054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-716380e8-54b0-40af-a73b-3bce680a7112 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:07.805538 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-716380e8-54b0-40af-a73b-3bce680a7112 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:07.807431 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-716380e8-54b0-40af-a73b-3bce680a7112 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:07.808274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-716380e8-54b0-40af-a73b-3bce680a7112 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:08.022274 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f2a208b2-df9d-4aec-be98-2fac941809cd tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:08.026333 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-716380e8-54b0-40af-a73b-3bce680a7112 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:08.033755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f2a208b2-df9d-4aec-be98-2fac941809cd tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.618578 Jun 04 18:29:08.035501 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-716380e8-54b0-40af-a73b-3bce680a7112 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1294 microversion: 2.1 time: 0.250518 Jun 04 18:29:08.036414 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 31/70] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:07 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:08.039914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 40/71] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:07 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1294 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:08.461459 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-32009902-e4c5-4e5a-91f4-5aad73eb5e17 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:08.462990 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-32009902-e4c5-4e5a-91f4-5aad73eb5e17 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:08.472049 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32009902-e4c5-4e5a-91f4-5aad73eb5e17 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:08.479100 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32009902-e4c5-4e5a-91f4-5aad73eb5e17 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:08.479973 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32009902-e4c5-4e5a-91f4-5aad73eb5e17 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:08.480469 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32009902-e4c5-4e5a-91f4-5aad73eb5e17 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:08.742897 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-32009902-e4c5-4e5a-91f4-5aad73eb5e17 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:08.756507 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-32009902-e4c5-4e5a-91f4-5aad73eb5e17 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1280 microversion: 2.1 time: 0.301109 Jun 04 18:29:08.761612 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 32/72] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:08 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:09.073368 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-acb264aa-6261-4774-afd0-73b5de92c2f0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:09.074783 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dc0abf7d-a744-48c0-980f-6eb7162aebf3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:09.086362 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dc0abf7d-a744-48c0-980f-6eb7162aebf3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:09.086440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-acb264aa-6261-4774-afd0-73b5de92c2f0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:09.116453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acb264aa-6261-4774-afd0-73b5de92c2f0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:09.127198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acb264aa-6261-4774-afd0-73b5de92c2f0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:09.128040 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dc0abf7d-a744-48c0-980f-6eb7162aebf3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:09.128711 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dc0abf7d-a744-48c0-980f-6eb7162aebf3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:09.129560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dc0abf7d-a744-48c0-980f-6eb7162aebf3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:09.132233 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acb264aa-6261-4774-afd0-73b5de92c2f0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:09.136260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acb264aa-6261-4774-afd0-73b5de92c2f0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:09.137062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dc0abf7d-a744-48c0-980f-6eb7162aebf3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:09.817445 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dc0abf7d-a744-48c0-980f-6eb7162aebf3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:09.834403 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dc0abf7d-a744-48c0-980f-6eb7162aebf3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.785640 Jun 04 18:29:09.835816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 41/73] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:09 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:09.845234 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-aceef8fc-03d0-4ce5-a24c-3b5ef55daf99 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:09.846202 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-aceef8fc-03d0-4ce5-a24c-3b5ef55daf99 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:09.857559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aceef8fc-03d0-4ce5-a24c-3b5ef55daf99 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:09.858378 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aceef8fc-03d0-4ce5-a24c-3b5ef55daf99 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:09.859489 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aceef8fc-03d0-4ce5-a24c-3b5ef55daf99 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:09.860493 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aceef8fc-03d0-4ce5-a24c-3b5ef55daf99 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:10.106252 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-acb264aa-6261-4774-afd0-73b5de92c2f0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:10.124815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-acb264aa-6261-4774-afd0-73b5de92c2f0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1294 microversion: 2.1 time: 1.071265 Jun 04 18:29:10.126610 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 33/74] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:09 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1294 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:10.382298 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-aceef8fc-03d0-4ce5-a24c-3b5ef55daf99 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:10.395652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-aceef8fc-03d0-4ce5-a24c-3b5ef55daf99 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1280 microversion: 2.1 time: 0.557261 Jun 04 18:29:10.403939 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 42/75] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:09 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1280 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:10.854594 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-432f6110-209c-4cc4-92c4-bd0db27a0b9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:10.855449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-432f6110-209c-4cc4-92c4-bd0db27a0b9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:10.863425 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-432f6110-209c-4cc4-92c4-bd0db27a0b9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:10.864243 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-432f6110-209c-4cc4-92c4-bd0db27a0b9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:10.865294 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-432f6110-209c-4cc4-92c4-bd0db27a0b9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:10.865894 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-432f6110-209c-4cc4-92c4-bd0db27a0b9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:11.143096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f3a8a711-1ffc-4a92-9956-2db422fbe77c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:11.144782 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f3a8a711-1ffc-4a92-9956-2db422fbe77c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:11.168390 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f3a8a711-1ffc-4a92-9956-2db422fbe77c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:11.171054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f3a8a711-1ffc-4a92-9956-2db422fbe77c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:11.175290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f3a8a711-1ffc-4a92-9956-2db422fbe77c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:11.178659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f3a8a711-1ffc-4a92-9956-2db422fbe77c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:11.354165 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f3a8a711-1ffc-4a92-9956-2db422fbe77c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:11.379803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f3a8a711-1ffc-4a92-9956-2db422fbe77c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1294 microversion: 2.1 time: 0.241517 Jun 04 18:29:11.380828 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 43/76] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:11 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1294 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:11.420649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-deefdd7d-b948-43b6-99c4-9d6694f2d7f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:11.421970 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-deefdd7d-b948-43b6-99c4-9d6694f2d7f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:11.441014 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-deefdd7d-b948-43b6-99c4-9d6694f2d7f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:11.442201 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-deefdd7d-b948-43b6-99c4-9d6694f2d7f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:11.443529 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-deefdd7d-b948-43b6-99c4-9d6694f2d7f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:11.444225 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-deefdd7d-b948-43b6-99c4-9d6694f2d7f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:11.590041 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-deefdd7d-b948-43b6-99c4-9d6694f2d7f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:11.601313 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-deefdd7d-b948-43b6-99c4-9d6694f2d7f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1280 microversion: 2.1 time: 0.181837 Jun 04 18:29:11.601976 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 44/77] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:11 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:12.083224 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-432f6110-209c-4cc4-92c4-bd0db27a0b9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:12.105087 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-432f6110-209c-4cc4-92c4-bd0db27a0b9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 1.242316 Jun 04 18:29:12.109543 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 34/78] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:10 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:12.398557 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-28a313c7-41c4-4cb8-8898-7760951722b9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:12.399390 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-28a313c7-41c4-4cb8-8898-7760951722b9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:12.413970 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28a313c7-41c4-4cb8-8898-7760951722b9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:12.416535 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28a313c7-41c4-4cb8-8898-7760951722b9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:12.425255 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28a313c7-41c4-4cb8-8898-7760951722b9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:12.425899 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28a313c7-41c4-4cb8-8898-7760951722b9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:12.630511 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c012503b-f679-4bbb-aea7-f3718c6a25e5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:12.632687 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c012503b-f679-4bbb-aea7-f3718c6a25e5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:12.641120 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c012503b-f679-4bbb-aea7-f3718c6a25e5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:12.656858 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c012503b-f679-4bbb-aea7-f3718c6a25e5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:12.659304 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c012503b-f679-4bbb-aea7-f3718c6a25e5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:12.661211 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c012503b-f679-4bbb-aea7-f3718c6a25e5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:13.017650 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:13.182960 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-28a313c7-41c4-4cb8-8898-7760951722b9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:13.209824 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-28a313c7-41c4-4cb8-8898-7760951722b9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.816016 Jun 04 18:29:13.223268 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 45/79] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:12 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:13.512098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=12 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:13.787804 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-db7e8216-e059-4dce-b036-11c7976262e1 req-09f17220-b354-4961-b818-60b612a4b019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ab578f-9f7c-43f7-9a6c-ca54c0b9345c", "tag": "2f300406-b453-4822-9635-d2e675926f86"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:13.814266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c012503b-f679-4bbb-aea7-f3718c6a25e5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:13.827808 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c012503b-f679-4bbb-aea7-f3718c6a25e5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 1.211933 Jun 04 18:29:13.830342 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 35/80] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:12 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:13.839204 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-db7e8216-e059-4dce-b036-11c7976262e1 req-09f17220-b354-4961-b818-60b612a4b019 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:13.840096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-db7e8216-e059-4dce-b036-11c7976262e1 req-09f17220-b354-4961-b818-60b612a4b019 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:13.859847 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7c8ac456-8131-4032-adc8-97d6dabb597f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:13.860499 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7c8ac456-8131-4032-adc8-97d6dabb597f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:13.908787 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c8ac456-8131-4032-adc8-97d6dabb597f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:13.909742 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c8ac456-8131-4032-adc8-97d6dabb597f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:13.914503 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c8ac456-8131-4032-adc8-97d6dabb597f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:13.916618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c8ac456-8131-4032-adc8-97d6dabb597f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:13.923161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-db7e8216-e059-4dce-b036-11c7976262e1 req-09f17220-b354-4961-b818-60b612a4b019 service nova] Creating event network-changed:2f300406-b453-4822-9635-d2e675926f86 for instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c on hv-cinder-79053 Jun 04 18:29:13.926302 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-db7e8216-e059-4dce-b036-11c7976262e1 req-09f17220-b354-4961-b818-60b612a4b019 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 18:29:13.932525 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8086256c-7ee7-4e7a-840a-7a50043b0758 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:13.934718 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8086256c-7ee7-4e7a-840a-7a50043b0758 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:13.940241 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8086256c-7ee7-4e7a-840a-7a50043b0758 None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:13.942929 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8086256c-7ee7-4e7a-840a-7a50043b0758 None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:13.994813 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.compute.rpcapi [None req-8086256c-7ee7-4e7a-840a-7a50043b0758 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 04 18:29:13.995730 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8086256c-7ee7-4e7a-840a-7a50043b0758 None None] Releasing lock "compute-rpcapi-router" {{(pid=117732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 18:29:14.056494 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8086256c-7ee7-4e7a-840a-7a50043b0758 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.828018 Jun 04 18:29:14.063971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 46/81] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:14.232768 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ca41021d-062e-42d7-ac78-3537516b7587 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:14.233817 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ca41021d-062e-42d7-ac78-3537516b7587 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:14.247989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca41021d-062e-42d7-ac78-3537516b7587 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:14.250787 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca41021d-062e-42d7-ac78-3537516b7587 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:14.252113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca41021d-062e-42d7-ac78-3537516b7587 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:14.253937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca41021d-062e-42d7-ac78-3537516b7587 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:14.322542 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7c8ac456-8131-4032-adc8-97d6dabb597f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:14.342383 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7c8ac456-8131-4032-adc8-97d6dabb597f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.502879 Jun 04 18:29:14.345695 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 36/82] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:13 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:14.846601 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7a1a912d-5f69-45dd-9bc8-9c0e12163ca4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:14.847360 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7a1a912d-5f69-45dd-9bc8-9c0e12163ca4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:14.850220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:14.872160 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a1a912d-5f69-45dd-9bc8-9c0e12163ca4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:14.872931 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a1a912d-5f69-45dd-9bc8-9c0e12163ca4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:14.873846 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a1a912d-5f69-45dd-9bc8-9c0e12163ca4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:14.874289 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a1a912d-5f69-45dd-9bc8-9c0e12163ca4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:14.966336 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ca41021d-062e-42d7-ac78-3537516b7587 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:14.989328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ca41021d-062e-42d7-ac78-3537516b7587 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.762698 Jun 04 18:29:15.002061 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 47/83] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:14 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:15.389033 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=26 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:15.979631 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-18bfdacc-d1e5-4567-9661-649900656967 req-9a4b2316-b94b-4d0c-afcd-0b2df171df4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b484f9b-4abe-452f-9b72-0be6e5f44785", "tag": "3ed528b4-d466-4323-9818-85abaf4e3aff"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:16.002306 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-18bfdacc-d1e5-4567-9661-649900656967 req-9a4b2316-b94b-4d0c-afcd-0b2df171df4f service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:16.002755 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-18bfdacc-d1e5-4567-9661-649900656967 req-9a4b2316-b94b-4d0c-afcd-0b2df171df4f service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:16.049440 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-18bfdacc-d1e5-4567-9661-649900656967 req-9a4b2316-b94b-4d0c-afcd-0b2df171df4f service nova] Creating event network-changed:3ed528b4-d466-4323-9818-85abaf4e3aff for instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 on hv-cinder-79053 Jun 04 18:29:16.060316 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-18bfdacc-d1e5-4567-9661-649900656967 req-9a4b2316-b94b-4d0c-afcd-0b2df171df4f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.739252 Jun 04 18:29:16.071919 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 48/84] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:29:16.090183 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6196a484-2888-47b2-a2fb-bbce7bb47c50 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:16.094462 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6196a484-2888-47b2-a2fb-bbce7bb47c50 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:16.123775 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6196a484-2888-47b2-a2fb-bbce7bb47c50 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:16.126396 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6196a484-2888-47b2-a2fb-bbce7bb47c50 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:16.129469 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6196a484-2888-47b2-a2fb-bbce7bb47c50 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:16.130132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6196a484-2888-47b2-a2fb-bbce7bb47c50 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:16.137809 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:16.726897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6196a484-2888-47b2-a2fb-bbce7bb47c50 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:16.740573 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6196a484-2888-47b2-a2fb-bbce7bb47c50 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.665333 Jun 04 18:29:16.741930 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 49/85] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:16 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:16.754348 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d92b9b02-2488-4e6b-a114-ddfdd09c3b71 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:16.756371 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d92b9b02-2488-4e6b-a114-ddfdd09c3b71 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:16.779219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d92b9b02-2488-4e6b-a114-ddfdd09c3b71 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:16.780262 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d92b9b02-2488-4e6b-a114-ddfdd09c3b71 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:16.782578 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d92b9b02-2488-4e6b-a114-ddfdd09c3b71 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:16.784544 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d92b9b02-2488-4e6b-a114-ddfdd09c3b71 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:16.887617 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7a1a912d-5f69-45dd-9bc8-9c0e12163ca4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:16.911488 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7a1a912d-5f69-45dd-9bc8-9c0e12163ca4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 2.067772 Jun 04 18:29:16.914067 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 37/86] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:14 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:17.583179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d92b9b02-2488-4e6b-a114-ddfdd09c3b71 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:17.590902 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d92b9b02-2488-4e6b-a114-ddfdd09c3b71 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.846327 Jun 04 18:29:17.605308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 50/87] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:16 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:17.764824 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-839d9dc5-d385-4651-953b-aea8370953fa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:17.766146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-839d9dc5-d385-4651-953b-aea8370953fa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:17.768270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:17.801434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-839d9dc5-d385-4651-953b-aea8370953fa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:17.804118 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-839d9dc5-d385-4651-953b-aea8370953fa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:17.805215 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-839d9dc5-d385-4651-953b-aea8370953fa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:17.806442 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-839d9dc5-d385-4651-953b-aea8370953fa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:17.839753 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-b5d10f3c-eb74-49bf-848e-fcd31715f021 req-96fa1f7e-d539-4f7c-9ca3-6d1e7610a6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ade342-ad6d-48d1-909f-5f7530d99dbe", "tag": "f05c89f1-fde1-490d-acf9-e0339f649264"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:17.857726 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b5d10f3c-eb74-49bf-848e-fcd31715f021 req-96fa1f7e-d539-4f7c-9ca3-6d1e7610a6f6 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:17.858860 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b5d10f3c-eb74-49bf-848e-fcd31715f021 req-96fa1f7e-d539-4f7c-9ca3-6d1e7610a6f6 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:17.874838 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-b5d10f3c-eb74-49bf-848e-fcd31715f021 req-96fa1f7e-d539-4f7c-9ca3-6d1e7610a6f6 service nova] Creating event network-changed:f05c89f1-fde1-490d-acf9-e0339f649264 for instance 43ade342-ad6d-48d1-909f-5f7530d99dbe on hv-cinder-79053 Jun 04 18:29:17.877662 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=73 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:17.885972 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-b5d10f3c-eb74-49bf-848e-fcd31715f021 req-96fa1f7e-d539-4f7c-9ca3-6d1e7610a6f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053806 Jun 04 18:29:17.888068 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 51/88] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:29:17.933192 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a45773f6-a979-4c4a-9db6-5420ae6e35a3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:17.934345 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a45773f6-a979-4c4a-9db6-5420ae6e35a3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:17.952211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a45773f6-a979-4c4a-9db6-5420ae6e35a3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:17.953010 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a45773f6-a979-4c4a-9db6-5420ae6e35a3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:17.954332 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a45773f6-a979-4c4a-9db6-5420ae6e35a3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:17.954937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a45773f6-a979-4c4a-9db6-5420ae6e35a3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:18.210973 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-839d9dc5-d385-4651-953b-aea8370953fa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:18.227519 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-839d9dc5-d385-4651-953b-aea8370953fa tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.472513 Jun 04 18:29:18.230854 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 38/89] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:17 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:18.332747 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a45773f6-a979-4c4a-9db6-5420ae6e35a3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:18.340290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a45773f6-a979-4c4a-9db6-5420ae6e35a3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.412784 Jun 04 18:29:18.340885 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 52/90] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:17 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:18.610479 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-51643860-40bd-4bac-8047-2b7a8f04fbc3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:18.611096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-51643860-40bd-4bac-8047-2b7a8f04fbc3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:18.619277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-51643860-40bd-4bac-8047-2b7a8f04fbc3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:18.620799 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-51643860-40bd-4bac-8047-2b7a8f04fbc3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:18.622136 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-51643860-40bd-4bac-8047-2b7a8f04fbc3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:18.623624 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-51643860-40bd-4bac-8047-2b7a8f04fbc3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:18.867444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-51643860-40bd-4bac-8047-2b7a8f04fbc3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:18.878593 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-51643860-40bd-4bac-8047-2b7a8f04fbc3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.272670 Jun 04 18:29:18.885207 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 39/91] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:18 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:19.258737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-44758998-b5ce-43b5-a4eb-0cb54a889ead tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:19.262545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-44758998-b5ce-43b5-a4eb-0cb54a889ead tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:19.271998 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:19.289590 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44758998-b5ce-43b5-a4eb-0cb54a889ead tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:19.290854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44758998-b5ce-43b5-a4eb-0cb54a889ead tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:19.294617 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44758998-b5ce-43b5-a4eb-0cb54a889ead tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:19.295354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44758998-b5ce-43b5-a4eb-0cb54a889ead tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:19.360035 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a4ca133b-4fd1-4842-ab5e-7c1f2799564c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:19.362695 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a4ca133b-4fd1-4842-ab5e-7c1f2799564c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:19.380390 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a4ca133b-4fd1-4842-ab5e-7c1f2799564c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:19.381079 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a4ca133b-4fd1-4842-ab5e-7c1f2799564c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:19.383139 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a4ca133b-4fd1-4842-ab5e-7c1f2799564c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:19.384325 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a4ca133b-4fd1-4842-ab5e-7c1f2799564c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:19.693041 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-44758998-b5ce-43b5-a4eb-0cb54a889ead tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:19.702039 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-44758998-b5ce-43b5-a4eb-0cb54a889ead tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.460126 Jun 04 18:29:19.706415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 53/92] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:19 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:19.731737 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a4ca133b-4fd1-4842-ab5e-7c1f2799564c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:19.739903 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a4ca133b-4fd1-4842-ab5e-7c1f2799564c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.385855 Jun 04 18:29:19.749976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 40/93] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:19 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:19.901758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d93c370-94c3-4325-b603-8c93b4ae0ee3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:19.904283 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7d93c370-94c3-4325-b603-8c93b4ae0ee3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:19.911463 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-ac798b01-2ccb-4919-9bb4-8537f6df68d9 req-f9250c6d-3974-4f89-8739-f0ceedbc01e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ac4261-d93e-474e-84f7-9941b02a97c3", "tag": "dceed2f4-0207-4e67-bd10-c14cc090441a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:19.911615 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d93c370-94c3-4325-b603-8c93b4ae0ee3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:19.912302 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d93c370-94c3-4325-b603-8c93b4ae0ee3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:19.914174 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d93c370-94c3-4325-b603-8c93b4ae0ee3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:19.914802 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d93c370-94c3-4325-b603-8c93b4ae0ee3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:19.938947 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ac798b01-2ccb-4919-9bb4-8537f6df68d9 req-f9250c6d-3974-4f89-8739-f0ceedbc01e7 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:19.939428 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ac798b01-2ccb-4919-9bb4-8537f6df68d9 req-f9250c6d-3974-4f89-8739-f0ceedbc01e7 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:19.994777 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-ac798b01-2ccb-4919-9bb4-8537f6df68d9 req-f9250c6d-3974-4f89-8739-f0ceedbc01e7 service nova] Creating event network-changed:dceed2f4-0207-4e67-bd10-c14cc090441a for instance 84ac4261-d93e-474e-84f7-9941b02a97c3 on hv-cinder-79053 Jun 04 18:29:19.997237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ac798b01-2ccb-4919-9bb4-8537f6df68d9 req-f9250c6d-3974-4f89-8739-f0ceedbc01e7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 18:29:19.998939 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-48fb0610-9910-48f4-b160-3f33486e40e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:19.999393 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-48fb0610-9910-48f4-b160-3f33486e40e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:20.000214 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-48fb0610-9910-48f4-b160-3f33486e40e1 None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:20.000846 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-48fb0610-9910-48f4-b160-3f33486e40e1 None None] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:20.014894 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.compute.rpcapi [None req-48fb0610-9910-48f4-b160-3f33486e40e1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 04 18:29:20.016666 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-48fb0610-9910-48f4-b160-3f33486e40e1 None None] Releasing lock "compute-rpcapi-router" {{(pid=117731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 18:29:20.042288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-48fb0610-9910-48f4-b160-3f33486e40e1 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135817 Jun 04 18:29:20.043553 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 41/94] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:20.113811 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d93c370-94c3-4325-b603-8c93b4ae0ee3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:20.123736 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7d93c370-94c3-4325-b603-8c93b4ae0ee3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.231550 Jun 04 18:29:20.124411 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 54/95] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:19 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:20.722220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-12362a25-6744-4c8a-8f26-d8f62eef3949 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:20.723050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-12362a25-6744-4c8a-8f26-d8f62eef3949 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:20.731164 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-12362a25-6744-4c8a-8f26-d8f62eef3949 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:20.731971 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-12362a25-6744-4c8a-8f26-d8f62eef3949 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:20.732994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-12362a25-6744-4c8a-8f26-d8f62eef3949 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:20.733673 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-12362a25-6744-4c8a-8f26-d8f62eef3949 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:20.757085 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-02f84f1b-34af-49a1-8ef5-178c5a21368b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:20.758775 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-02f84f1b-34af-49a1-8ef5-178c5a21368b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:20.766744 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-02f84f1b-34af-49a1-8ef5-178c5a21368b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:20.767485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-02f84f1b-34af-49a1-8ef5-178c5a21368b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:20.768610 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-02f84f1b-34af-49a1-8ef5-178c5a21368b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:20.769238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-02f84f1b-34af-49a1-8ef5-178c5a21368b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:20.939675 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-02f84f1b-34af-49a1-8ef5-178c5a21368b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:20.952347 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-12362a25-6744-4c8a-8f26-d8f62eef3949 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:20.953445 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-02f84f1b-34af-49a1-8ef5-178c5a21368b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.200563 Jun 04 18:29:20.954349 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 55/96] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:20 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:20.962627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-12362a25-6744-4c8a-8f26-d8f62eef3949 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.244871 Jun 04 18:29:20.964461 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 42/97] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:20 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:21.142575 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e0940694-80d3-4656-ae33-6aba67d25d3c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:21.143664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e0940694-80d3-4656-ae33-6aba67d25d3c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:21.157389 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0940694-80d3-4656-ae33-6aba67d25d3c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:21.158046 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0940694-80d3-4656-ae33-6aba67d25d3c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:21.159299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0940694-80d3-4656-ae33-6aba67d25d3c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:21.160076 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0940694-80d3-4656-ae33-6aba67d25d3c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:21.377173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0940694-80d3-4656-ae33-6aba67d25d3c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:21.387031 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e0940694-80d3-4656-ae33-6aba67d25d3c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.249000 Jun 04 18:29:21.387606 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 56/98] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:21 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:21.971526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-66e2d946-978f-4fc5-96cd-0bd676be17ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:21.972749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-66e2d946-978f-4fc5-96cd-0bd676be17ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:21.980534 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4777391c-6b42-444e-9b70-e407c88f51f1 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:21.981019 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-66e2d946-978f-4fc5-96cd-0bd676be17ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:21.981326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-66e2d946-978f-4fc5-96cd-0bd676be17ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:21.981913 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4777391c-6b42-444e-9b70-e407c88f51f1 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:21.983133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-66e2d946-978f-4fc5-96cd-0bd676be17ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:21.984253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-66e2d946-978f-4fc5-96cd-0bd676be17ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:21.990124 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4777391c-6b42-444e-9b70-e407c88f51f1 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:21.990620 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4777391c-6b42-444e-9b70-e407c88f51f1 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:21.993732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4777391c-6b42-444e-9b70-e407c88f51f1 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:21.994387 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4777391c-6b42-444e-9b70-e407c88f51f1 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:22.143621 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4777391c-6b42-444e-9b70-e407c88f51f1 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:22.151177 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4777391c-6b42-444e-9b70-e407c88f51f1 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.175224 Jun 04 18:29:22.151873 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 57/99] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:21 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:22.200468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-66e2d946-978f-4fc5-96cd-0bd676be17ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:22.208896 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-66e2d946-978f-4fc5-96cd-0bd676be17ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.241994 Jun 04 18:29:22.209695 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 43/100] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:21 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:22.409585 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f7ed8af9-d026-4eb4-a30e-a4d1cd0c5462 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:22.410299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f7ed8af9-d026-4eb4-a30e-a4d1cd0c5462 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:22.417626 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7ed8af9-d026-4eb4-a30e-a4d1cd0c5462 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:22.418154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7ed8af9-d026-4eb4-a30e-a4d1cd0c5462 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:22.419003 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7ed8af9-d026-4eb4-a30e-a4d1cd0c5462 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:22.419558 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7ed8af9-d026-4eb4-a30e-a4d1cd0c5462 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:22.583359 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f7ed8af9-d026-4eb4-a30e-a4d1cd0c5462 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:22.592270 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f7ed8af9-d026-4eb4-a30e-a4d1cd0c5462 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.186664 Jun 04 18:29:22.593390 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 58/101] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:22 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:23.171633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4b1c442e-557c-48e6-acb1-5326fbfa15bc tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:23.171633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4b1c442e-557c-48e6-acb1-5326fbfa15bc tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:23.192474 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4b1c442e-557c-48e6-acb1-5326fbfa15bc tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:23.193010 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4b1c442e-557c-48e6-acb1-5326fbfa15bc tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:23.204785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4b1c442e-557c-48e6-acb1-5326fbfa15bc tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:23.204785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4b1c442e-557c-48e6-acb1-5326fbfa15bc tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:23.227985 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-198a5cc1-fad1-45e2-bcda-239960e70589 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:23.229709 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-198a5cc1-fad1-45e2-bcda-239960e70589 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:23.242676 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a5cc1-fad1-45e2-bcda-239960e70589 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:23.245068 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a5cc1-fad1-45e2-bcda-239960e70589 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:23.245977 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a5cc1-fad1-45e2-bcda-239960e70589 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:23.246539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a5cc1-fad1-45e2-bcda-239960e70589 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:23.401613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4b1c442e-557c-48e6-acb1-5326fbfa15bc tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:23.410183 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4b1c442e-557c-48e6-acb1-5326fbfa15bc tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.245524 Jun 04 18:29:23.410871 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 44/102] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:23 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:23.445149 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-198a5cc1-fad1-45e2-bcda-239960e70589 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:23.456640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-198a5cc1-fad1-45e2-bcda-239960e70589 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.234416 Jun 04 18:29:23.457404 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 59/103] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:23 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:23.609268 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0663cd4a-6a13-47db-b154-1af16da80560 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:23.609994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0663cd4a-6a13-47db-b154-1af16da80560 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:23.616644 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0663cd4a-6a13-47db-b154-1af16da80560 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:23.617289 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0663cd4a-6a13-47db-b154-1af16da80560 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:23.618275 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0663cd4a-6a13-47db-b154-1af16da80560 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:23.618769 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0663cd4a-6a13-47db-b154-1af16da80560 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:23.810624 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0663cd4a-6a13-47db-b154-1af16da80560 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:23.819737 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0663cd4a-6a13-47db-b154-1af16da80560 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.214342 Jun 04 18:29:23.820485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 45/104] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:23 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:24.430082 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1174eb61-66b1-43e7-a03d-85109f24062e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:24.431466 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1174eb61-66b1-43e7-a03d-85109f24062e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:24.438304 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:24.441876 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1174eb61-66b1-43e7-a03d-85109f24062e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:24.442550 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1174eb61-66b1-43e7-a03d-85109f24062e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:24.443664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1174eb61-66b1-43e7-a03d-85109f24062e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:24.444845 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1174eb61-66b1-43e7-a03d-85109f24062e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:24.474053 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-99fba4d7-fe59-4dfa-8f15-5579e61a40f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:24.474795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-99fba4d7-fe59-4dfa-8f15-5579e61a40f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:24.484972 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-99fba4d7-fe59-4dfa-8f15-5579e61a40f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:24.484972 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-99fba4d7-fe59-4dfa-8f15-5579e61a40f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:24.492514 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-99fba4d7-fe59-4dfa-8f15-5579e61a40f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:24.492961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-99fba4d7-fe59-4dfa-8f15-5579e61a40f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:24.651097 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1174eb61-66b1-43e7-a03d-85109f24062e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:24.664555 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1174eb61-66b1-43e7-a03d-85109f24062e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.235942 Jun 04 18:29:24.664555 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 60/105] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:24 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:24.726926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-99fba4d7-fe59-4dfa-8f15-5579e61a40f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:24.743437 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-99fba4d7-fe59-4dfa-8f15-5579e61a40f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.272230 Jun 04 18:29:24.746950 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 46/106] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:24 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:24.764331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-80afc53c-7650-4471-9a61-e27a081ebe06 req-e8da2ca4-7fe0-4871-b415-acaf95ec7d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ab578f-9f7c-43f7-9a6c-ca54c0b9345c", "name": "network-vif-plugged", "status": "completed", "tag": "2f300406-b453-4822-9635-d2e675926f86"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:24.773320 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-80afc53c-7650-4471-9a61-e27a081ebe06 req-e8da2ca4-7fe0-4871-b415-acaf95ec7d73 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:24.774056 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-80afc53c-7650-4471-9a61-e27a081ebe06 req-e8da2ca4-7fe0-4871-b415-acaf95ec7d73 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:24.788824 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-80afc53c-7650-4471-9a61-e27a081ebe06 req-e8da2ca4-7fe0-4871-b415-acaf95ec7d73 service nova] Creating event network-vif-plugged:2f300406-b453-4822-9635-d2e675926f86 for instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c on hv-cinder-79053 Jun 04 18:29:24.794513 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-80afc53c-7650-4471-9a61-e27a081ebe06 req-e8da2ca4-7fe0-4871-b415-acaf95ec7d73 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131287 Jun 04 18:29:24.795676 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 61/107] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:24.838928 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d1b79ff9-15fc-4418-aa2e-69e0cf46c253 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:24.839816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d1b79ff9-15fc-4418-aa2e-69e0cf46c253 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:24.848293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1b79ff9-15fc-4418-aa2e-69e0cf46c253 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:24.848737 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1b79ff9-15fc-4418-aa2e-69e0cf46c253 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:24.849827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1b79ff9-15fc-4418-aa2e-69e0cf46c253 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:24.850573 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1b79ff9-15fc-4418-aa2e-69e0cf46c253 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:25.057293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d1b79ff9-15fc-4418-aa2e-69e0cf46c253 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:25.068749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d1b79ff9-15fc-4418-aa2e-69e0cf46c253 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.234329 Jun 04 18:29:25.069937 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 47/108] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:24 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:25.682074 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e98e93fb-7a80-4581-b437-3860d6e2c475 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:25.683695 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e98e93fb-7a80-4581-b437-3860d6e2c475 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:25.692199 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e98e93fb-7a80-4581-b437-3860d6e2c475 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:25.692919 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e98e93fb-7a80-4581-b437-3860d6e2c475 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:25.693989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e98e93fb-7a80-4581-b437-3860d6e2c475 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:25.694757 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e98e93fb-7a80-4581-b437-3860d6e2c475 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:25.764109 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b8b81f59-cb63-46f1-9bbb-f6823f25453c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:25.764718 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b8b81f59-cb63-46f1-9bbb-f6823f25453c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:25.779041 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8b81f59-cb63-46f1-9bbb-f6823f25453c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:25.779041 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8b81f59-cb63-46f1-9bbb-f6823f25453c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:25.779041 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8b81f59-cb63-46f1-9bbb-f6823f25453c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:25.779041 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8b81f59-cb63-46f1-9bbb-f6823f25453c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:25.931194 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e98e93fb-7a80-4581-b437-3860d6e2c475 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:25.940850 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e98e93fb-7a80-4581-b437-3860d6e2c475 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.265162 Jun 04 18:29:25.941521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 62/109] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:25 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:26.007101 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b8b81f59-cb63-46f1-9bbb-f6823f25453c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:26.026560 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b8b81f59-cb63-46f1-9bbb-f6823f25453c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.266470 Jun 04 18:29:26.028609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 48/110] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:25 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:26.086509 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e3d42edf-0da0-4916-811f-b860755a4d5f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:26.087188 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e3d42edf-0da0-4916-811f-b860755a4d5f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:26.097262 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3d42edf-0da0-4916-811f-b860755a4d5f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:26.097736 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3d42edf-0da0-4916-811f-b860755a4d5f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:26.099000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3d42edf-0da0-4916-811f-b860755a4d5f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:26.099586 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3d42edf-0da0-4916-811f-b860755a4d5f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:26.333004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e3d42edf-0da0-4916-811f-b860755a4d5f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:26.342749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e3d42edf-0da0-4916-811f-b860755a4d5f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.260172 Jun 04 18:29:26.343439 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 63/111] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:26 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:26.957475 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-91f8c194-a44f-4cae-b4c6-1d777300ccbe tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:26.958052 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-91f8c194-a44f-4cae-b4c6-1d777300ccbe tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:26.965563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91f8c194-a44f-4cae-b4c6-1d777300ccbe tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:26.966498 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91f8c194-a44f-4cae-b4c6-1d777300ccbe tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:26.967620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91f8c194-a44f-4cae-b4c6-1d777300ccbe tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:26.968286 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91f8c194-a44f-4cae-b4c6-1d777300ccbe tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:27.045073 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ace5da17-6d92-44f3-8cd2-1cbf59745dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:27.046458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ace5da17-6d92-44f3-8cd2-1cbf59745dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:27.054554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ace5da17-6d92-44f3-8cd2-1cbf59745dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:27.055269 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ace5da17-6d92-44f3-8cd2-1cbf59745dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:27.056076 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ace5da17-6d92-44f3-8cd2-1cbf59745dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:27.056528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ace5da17-6d92-44f3-8cd2-1cbf59745dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:27.212109 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91f8c194-a44f-4cae-b4c6-1d777300ccbe tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:27.225592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-91f8c194-a44f-4cae-b4c6-1d777300ccbe tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.272088 Jun 04 18:29:27.226181 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 49/112] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:26 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:27.291719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ace5da17-6d92-44f3-8cd2-1cbf59745dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:27.305633 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ace5da17-6d92-44f3-8cd2-1cbf59745dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.264759 Jun 04 18:29:27.306843 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 64/113] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:27 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:27.360329 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5d12572e-cf77-4ae6-bb9d-337c2bf3ad19 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:27.361015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5d12572e-cf77-4ae6-bb9d-337c2bf3ad19 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:27.367992 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d12572e-cf77-4ae6-bb9d-337c2bf3ad19 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:27.368601 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d12572e-cf77-4ae6-bb9d-337c2bf3ad19 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:27.369363 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d12572e-cf77-4ae6-bb9d-337c2bf3ad19 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:27.369972 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d12572e-cf77-4ae6-bb9d-337c2bf3ad19 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:27.552124 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5d12572e-cf77-4ae6-bb9d-337c2bf3ad19 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:27.560692 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5d12572e-cf77-4ae6-bb9d-337c2bf3ad19 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.204675 Jun 04 18:29:27.570868 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 50/114] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:27 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:28.244059 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ef16c32b-cf8e-4b91-9ade-ddf619ff2778 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:28.245026 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ef16c32b-cf8e-4b91-9ade-ddf619ff2778 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:28.256088 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef16c32b-cf8e-4b91-9ade-ddf619ff2778 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:28.256598 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef16c32b-cf8e-4b91-9ade-ddf619ff2778 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:28.257663 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef16c32b-cf8e-4b91-9ade-ddf619ff2778 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:28.258176 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef16c32b-cf8e-4b91-9ade-ddf619ff2778 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:28.327743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0f8d46be-746f-43f5-8375-13c8be418d6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:28.328282 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0f8d46be-746f-43f5-8375-13c8be418d6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:28.336946 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f8d46be-746f-43f5-8375-13c8be418d6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:28.337613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f8d46be-746f-43f5-8375-13c8be418d6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:28.338603 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f8d46be-746f-43f5-8375-13c8be418d6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:28.339231 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f8d46be-746f-43f5-8375-13c8be418d6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:28.470082 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ef16c32b-cf8e-4b91-9ade-ddf619ff2778 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:28.478479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ef16c32b-cf8e-4b91-9ade-ddf619ff2778 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.239940 Jun 04 18:29:28.480327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 65/115] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:28 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:28.586122 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ecc5a5d8-bb5f-468e-9835-74fe52c2d845 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:28.586751 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ecc5a5d8-bb5f-468e-9835-74fe52c2d845 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:28.600803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecc5a5d8-bb5f-468e-9835-74fe52c2d845 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:28.601405 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecc5a5d8-bb5f-468e-9835-74fe52c2d845 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:28.603780 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecc5a5d8-bb5f-468e-9835-74fe52c2d845 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:28.604616 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecc5a5d8-bb5f-468e-9835-74fe52c2d845 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:28.731219 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0f8d46be-746f-43f5-8375-13c8be418d6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:28.741392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0f8d46be-746f-43f5-8375-13c8be418d6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.422476 Jun 04 18:29:28.742873 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 51/116] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:28 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:28.790706 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ecc5a5d8-bb5f-468e-9835-74fe52c2d845 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:28.798744 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ecc5a5d8-bb5f-468e-9835-74fe52c2d845 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.221316 Jun 04 18:29:28.799632 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 66/117] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:28 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:29.495739 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0dc8ee4d-1412-452a-9397-267fd02b3e88 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:29.496415 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0dc8ee4d-1412-452a-9397-267fd02b3e88 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:29.503231 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dc8ee4d-1412-452a-9397-267fd02b3e88 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:29.503904 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dc8ee4d-1412-452a-9397-267fd02b3e88 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:29.504780 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dc8ee4d-1412-452a-9397-267fd02b3e88 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:29.505308 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dc8ee4d-1412-452a-9397-267fd02b3e88 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:29.652350 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0dc8ee4d-1412-452a-9397-267fd02b3e88 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:29.661128 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0dc8ee4d-1412-452a-9397-267fd02b3e88 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.169201 Jun 04 18:29:29.662174 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 52/118] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:29 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:29.758667 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-92b4f664-544a-49de-813d-97fbbe561389 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:29.759273 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-92b4f664-544a-49de-813d-97fbbe561389 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:29.765675 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92b4f664-544a-49de-813d-97fbbe561389 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:29.766428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92b4f664-544a-49de-813d-97fbbe561389 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:29.767295 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92b4f664-544a-49de-813d-97fbbe561389 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:29.767732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92b4f664-544a-49de-813d-97fbbe561389 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:29.772070 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:29.817073 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b3fc451b-35a3-4b38-bb78-404819373146 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:29.817928 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b3fc451b-35a3-4b38-bb78-404819373146 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:29.824921 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b3fc451b-35a3-4b38-bb78-404819373146 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:29.826054 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b3fc451b-35a3-4b38-bb78-404819373146 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:29.827063 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b3fc451b-35a3-4b38-bb78-404819373146 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:29.827832 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b3fc451b-35a3-4b38-bb78-404819373146 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:29.921070 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-92b4f664-544a-49de-813d-97fbbe561389 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:29.931534 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-92b4f664-544a-49de-813d-97fbbe561389 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.176667 Jun 04 18:29:29.933483 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 67/119] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:29 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:30.013804 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:30.022570 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b3fc451b-35a3-4b38-bb78-404819373146 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:30.033274 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b3fc451b-35a3-4b38-bb78-404819373146 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.220604 Jun 04 18:29:30.034069 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 53/120] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:29 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:30.682714 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fe4da078-17c8-4c18-a836-7e5d8326654e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:30.683681 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fe4da078-17c8-4c18-a836-7e5d8326654e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:30.690311 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe4da078-17c8-4c18-a836-7e5d8326654e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:30.690785 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe4da078-17c8-4c18-a836-7e5d8326654e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:30.691659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe4da078-17c8-4c18-a836-7e5d8326654e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:30.692112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe4da078-17c8-4c18-a836-7e5d8326654e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:30.824493 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe4da078-17c8-4c18-a836-7e5d8326654e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:30.832269 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fe4da078-17c8-4c18-a836-7e5d8326654e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.156092 Jun 04 18:29:30.832966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 68/121] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:30 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:30.950263 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-eaf6838b-c894-4d9c-b8d3-b62cc273fdea tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:30.950987 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-eaf6838b-c894-4d9c-b8d3-b62cc273fdea tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:30.957125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaf6838b-c894-4d9c-b8d3-b62cc273fdea tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:30.957566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaf6838b-c894-4d9c-b8d3-b62cc273fdea tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:30.958321 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaf6838b-c894-4d9c-b8d3-b62cc273fdea tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:30.958739 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaf6838b-c894-4d9c-b8d3-b62cc273fdea tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:31.051179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e2503add-309e-49a4-b5e8-80741af7c259 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:31.051923 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e2503add-309e-49a4-b5e8-80741af7c259 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:31.058235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e2503add-309e-49a4-b5e8-80741af7c259 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:31.058906 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e2503add-309e-49a4-b5e8-80741af7c259 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:31.059997 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e2503add-309e-49a4-b5e8-80741af7c259 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:31.060754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e2503add-309e-49a4-b5e8-80741af7c259 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:31.117648 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-eaf6838b-c894-4d9c-b8d3-b62cc273fdea tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:31.121684 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-eaf6838b-c894-4d9c-b8d3-b62cc273fdea tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.175616 Jun 04 18:29:31.122732 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 54/122] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:30 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:31.238540 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e2503add-309e-49a4-b5e8-80741af7c259 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:31.247792 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e2503add-309e-49a4-b5e8-80741af7c259 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.200824 Jun 04 18:29:31.248612 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 69/123] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:31 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:31.849295 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e4a759b4-1603-436a-928a-7b03671c14b7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:31.849921 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e4a759b4-1603-436a-928a-7b03671c14b7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:31.856363 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e4a759b4-1603-436a-928a-7b03671c14b7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:31.856820 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e4a759b4-1603-436a-928a-7b03671c14b7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:31.857571 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e4a759b4-1603-436a-928a-7b03671c14b7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:31.858047 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e4a759b4-1603-436a-928a-7b03671c14b7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:31.860893 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:31.991992 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e4a759b4-1603-436a-928a-7b03671c14b7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:32.002679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e4a759b4-1603-436a-928a-7b03671c14b7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.157398 Jun 04 18:29:32.003497 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 55/124] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:31 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:32.138650 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-24f90628-cf6a-47f9-812d-46eb89ae9db6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:32.139927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-24f90628-cf6a-47f9-812d-46eb89ae9db6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:32.147127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24f90628-cf6a-47f9-812d-46eb89ae9db6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:32.147545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24f90628-cf6a-47f9-812d-46eb89ae9db6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:32.149976 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24f90628-cf6a-47f9-812d-46eb89ae9db6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:32.150420 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24f90628-cf6a-47f9-812d-46eb89ae9db6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:32.266809 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-52e348a9-f6ff-4e09-ba55-d7f8227027a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:32.267822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-52e348a9-f6ff-4e09-ba55-d7f8227027a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:32.277114 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-52e348a9-f6ff-4e09-ba55-d7f8227027a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:32.278356 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-52e348a9-f6ff-4e09-ba55-d7f8227027a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:32.280926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-52e348a9-f6ff-4e09-ba55-d7f8227027a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:32.281585 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-52e348a9-f6ff-4e09-ba55-d7f8227027a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:32.308435 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-24f90628-cf6a-47f9-812d-46eb89ae9db6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:32.319054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-24f90628-cf6a-47f9-812d-46eb89ae9db6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.184206 Jun 04 18:29:32.319633 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 70/125] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:32 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:32.472703 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-52e348a9-f6ff-4e09-ba55-d7f8227027a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:32.480040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-52e348a9-f6ff-4e09-ba55-d7f8227027a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.218809 Jun 04 18:29:32.481805 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 56/126] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:32 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:33.018644 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a654167d-abf5-4841-8f2d-663aa4904f71 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:33.019218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a654167d-abf5-4841-8f2d-663aa4904f71 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:33.025213 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a654167d-abf5-4841-8f2d-663aa4904f71 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:33.025658 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a654167d-abf5-4841-8f2d-663aa4904f71 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:33.026403 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a654167d-abf5-4841-8f2d-663aa4904f71 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:33.026831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a654167d-abf5-4841-8f2d-663aa4904f71 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:33.162271 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a654167d-abf5-4841-8f2d-663aa4904f71 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:33.171764 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a654167d-abf5-4841-8f2d-663aa4904f71 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.156922 Jun 04 18:29:33.172369 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 71/127] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:33 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:33.335996 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b6635680-5e42-4f60-be97-4886f830cd6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:33.336790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b6635680-5e42-4f60-be97-4886f830cd6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:33.343829 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6635680-5e42-4f60-be97-4886f830cd6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:33.344318 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6635680-5e42-4f60-be97-4886f830cd6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:33.345264 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6635680-5e42-4f60-be97-4886f830cd6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:33.345569 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6635680-5e42-4f60-be97-4886f830cd6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:33.486260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b6635680-5e42-4f60-be97-4886f830cd6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:33.497994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b6635680-5e42-4f60-be97-4886f830cd6e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.164510 Jun 04 18:29:33.499061 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 57/128] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:33 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:33.499184 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1a257d65-8b5a-4b78-8b8c-f46d3b2fce3f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:33.501480 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1a257d65-8b5a-4b78-8b8c-f46d3b2fce3f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:33.507693 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a257d65-8b5a-4b78-8b8c-f46d3b2fce3f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:33.508171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a257d65-8b5a-4b78-8b8c-f46d3b2fce3f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:33.509046 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a257d65-8b5a-4b78-8b8c-f46d3b2fce3f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:33.509526 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a257d65-8b5a-4b78-8b8c-f46d3b2fce3f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:33.652271 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1a257d65-8b5a-4b78-8b8c-f46d3b2fce3f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:33.662499 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1a257d65-8b5a-4b78-8b8c-f46d3b2fce3f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.168073 Jun 04 18:29:33.663216 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 72/129] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:33 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:34.189966 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f67fece5-2c9e-45f1-a6ae-0ba0479f039c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:34.190580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f67fece5-2c9e-45f1-a6ae-0ba0479f039c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:34.197164 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f67fece5-2c9e-45f1-a6ae-0ba0479f039c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:34.197609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f67fece5-2c9e-45f1-a6ae-0ba0479f039c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:34.198368 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f67fece5-2c9e-45f1-a6ae-0ba0479f039c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:34.198800 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f67fece5-2c9e-45f1-a6ae-0ba0479f039c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:34.338988 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f67fece5-2c9e-45f1-a6ae-0ba0479f039c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:34.346925 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f67fece5-2c9e-45f1-a6ae-0ba0479f039c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.160881 Jun 04 18:29:34.347514 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 58/130] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:34 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:34.516155 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-34510f4a-e7f5-4e4f-bea5-d089dda99a34 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:34.517323 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-34510f4a-e7f5-4e4f-bea5-d089dda99a34 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:34.523740 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34510f4a-e7f5-4e4f-bea5-d089dda99a34 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:34.524224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34510f4a-e7f5-4e4f-bea5-d089dda99a34 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:34.524986 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34510f4a-e7f5-4e4f-bea5-d089dda99a34 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:34.525419 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34510f4a-e7f5-4e4f-bea5-d089dda99a34 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:34.658230 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-34510f4a-e7f5-4e4f-bea5-d089dda99a34 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:34.666214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-34510f4a-e7f5-4e4f-bea5-d089dda99a34 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.154264 Jun 04 18:29:34.666768 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 73/131] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:34 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:34.679175 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-25af4fc8-8c77-4a11-a5a1-aecbf000aea2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:34.679786 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-25af4fc8-8c77-4a11-a5a1-aecbf000aea2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:34.686446 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25af4fc8-8c77-4a11-a5a1-aecbf000aea2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:34.686885 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25af4fc8-8c77-4a11-a5a1-aecbf000aea2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:34.687637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25af4fc8-8c77-4a11-a5a1-aecbf000aea2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:34.688137 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25af4fc8-8c77-4a11-a5a1-aecbf000aea2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:34.816453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-25af4fc8-8c77-4a11-a5a1-aecbf000aea2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:34.823873 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-25af4fc8-8c77-4a11-a5a1-aecbf000aea2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.148598 Jun 04 18:29:34.824457 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 59/132] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:34 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:35.363542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-287a36a7-1b9a-49e7-8260-5082fe265921 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:35.364148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-287a36a7-1b9a-49e7-8260-5082fe265921 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:35.370293 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-287a36a7-1b9a-49e7-8260-5082fe265921 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:35.370739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-287a36a7-1b9a-49e7-8260-5082fe265921 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:35.371485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-287a36a7-1b9a-49e7-8260-5082fe265921 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:35.371914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-287a36a7-1b9a-49e7-8260-5082fe265921 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:35.515485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-287a36a7-1b9a-49e7-8260-5082fe265921 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:35.523330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-287a36a7-1b9a-49e7-8260-5082fe265921 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.163710 Jun 04 18:29:35.525622 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 74/133] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:35 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:35.683161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5f822c13-fff4-4d5a-a6a2-dd4b6c3b6bce tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:35.684584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5f822c13-fff4-4d5a-a6a2-dd4b6c3b6bce tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:35.691288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f822c13-fff4-4d5a-a6a2-dd4b6c3b6bce tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:35.691729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f822c13-fff4-4d5a-a6a2-dd4b6c3b6bce tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:35.692496 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f822c13-fff4-4d5a-a6a2-dd4b6c3b6bce tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:35.692953 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f822c13-fff4-4d5a-a6a2-dd4b6c3b6bce tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:35.824236 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5f822c13-fff4-4d5a-a6a2-dd4b6c3b6bce tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:35.832771 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5f822c13-fff4-4d5a-a6a2-dd4b6c3b6bce tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.153413 Jun 04 18:29:35.833348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 60/134] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:35 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:35.841502 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-695decfb-4cfd-471f-8945-b97098871c00 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:35.843391 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-695decfb-4cfd-471f-8945-b97098871c00 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:35.849808 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-695decfb-4cfd-471f-8945-b97098871c00 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:35.850266 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-695decfb-4cfd-471f-8945-b97098871c00 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:35.851034 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-695decfb-4cfd-471f-8945-b97098871c00 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:35.851468 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-695decfb-4cfd-471f-8945-b97098871c00 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:35.985263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-695decfb-4cfd-471f-8945-b97098871c00 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:35.996972 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-695decfb-4cfd-471f-8945-b97098871c00 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.159659 Jun 04 18:29:35.997748 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 75/135] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:35 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:36.545005 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dbad0f8a-9966-4684-b213-681f2d776c35 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:36.546011 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dbad0f8a-9966-4684-b213-681f2d776c35 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:36.556305 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dbad0f8a-9966-4684-b213-681f2d776c35 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:36.557025 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dbad0f8a-9966-4684-b213-681f2d776c35 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:36.558283 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dbad0f8a-9966-4684-b213-681f2d776c35 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:36.558998 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dbad0f8a-9966-4684-b213-681f2d776c35 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:36.698738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dbad0f8a-9966-4684-b213-681f2d776c35 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:36.710140 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dbad0f8a-9966-4684-b213-681f2d776c35 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.172078 Jun 04 18:29:36.710944 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 61/136] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:36 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:36.855415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ed400fc5-dac4-4fe5-aaec-5ac535dd267a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:36.856360 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ed400fc5-dac4-4fe5-aaec-5ac535dd267a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:36.863352 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed400fc5-dac4-4fe5-aaec-5ac535dd267a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:36.863808 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed400fc5-dac4-4fe5-aaec-5ac535dd267a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:36.864604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed400fc5-dac4-4fe5-aaec-5ac535dd267a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:36.865040 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed400fc5-dac4-4fe5-aaec-5ac535dd267a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:37.003426 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ed400fc5-dac4-4fe5-aaec-5ac535dd267a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:37.013105 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ed400fc5-dac4-4fe5-aaec-5ac535dd267a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.164057 Jun 04 18:29:37.013737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 76/137] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:36 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:37.015597 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-95233158-493b-453c-9f92-f2db58b8b1a9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:37.016244 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-95233158-493b-453c-9f92-f2db58b8b1a9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:37.022619 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95233158-493b-453c-9f92-f2db58b8b1a9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:37.023071 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95233158-493b-453c-9f92-f2db58b8b1a9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:37.023891 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95233158-493b-453c-9f92-f2db58b8b1a9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:37.024358 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95233158-493b-453c-9f92-f2db58b8b1a9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:37.179125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-95233158-493b-453c-9f92-f2db58b8b1a9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:37.187306 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-95233158-493b-453c-9f92-f2db58b8b1a9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.176678 Jun 04 18:29:37.187872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 62/138] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:37 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:37.212027 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-b09b0c50-1177-4345-abe7-35a6d36344c8 req-ce81f501-687f-4a44-82cc-aff919305937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b484f9b-4abe-452f-9b72-0be6e5f44785", "name": "network-vif-plugged", "status": "completed", "tag": "3ed528b4-d466-4323-9818-85abaf4e3aff"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:37.221053 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b09b0c50-1177-4345-abe7-35a6d36344c8 req-ce81f501-687f-4a44-82cc-aff919305937 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:37.221422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b09b0c50-1177-4345-abe7-35a6d36344c8 req-ce81f501-687f-4a44-82cc-aff919305937 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:37.233141 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-b09b0c50-1177-4345-abe7-35a6d36344c8 req-ce81f501-687f-4a44-82cc-aff919305937 service nova] Creating event network-vif-plugged:3ed528b4-d466-4323-9818-85abaf4e3aff for instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 on hv-cinder-79053 Jun 04 18:29:37.238103 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-b09b0c50-1177-4345-abe7-35a6d36344c8 req-ce81f501-687f-4a44-82cc-aff919305937 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029751 Jun 04 18:29:37.238788 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 77/139] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:37.726740 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7509c40c-71b9-45d9-bfc0-c37ba9b20e36 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:37.727386 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7509c40c-71b9-45d9-bfc0-c37ba9b20e36 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:37.734142 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7509c40c-71b9-45d9-bfc0-c37ba9b20e36 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:37.734588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7509c40c-71b9-45d9-bfc0-c37ba9b20e36 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:37.735345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7509c40c-71b9-45d9-bfc0-c37ba9b20e36 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:37.735791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7509c40c-71b9-45d9-bfc0-c37ba9b20e36 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:37.906802 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7509c40c-71b9-45d9-bfc0-c37ba9b20e36 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:37.916280 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7509c40c-71b9-45d9-bfc0-c37ba9b20e36 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.193484 Jun 04 18:29:37.916972 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 63/140] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:37 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:38.033230 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9a16c275-17e5-4b10-8c28-815dfbe985c0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:38.033921 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9a16c275-17e5-4b10-8c28-815dfbe985c0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:38.040479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a16c275-17e5-4b10-8c28-815dfbe985c0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:38.040922 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a16c275-17e5-4b10-8c28-815dfbe985c0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:38.041675 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a16c275-17e5-4b10-8c28-815dfbe985c0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:38.042105 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a16c275-17e5-4b10-8c28-815dfbe985c0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:38.177405 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9a16c275-17e5-4b10-8c28-815dfbe985c0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:38.185536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9a16c275-17e5-4b10-8c28-815dfbe985c0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.156523 Jun 04 18:29:38.186388 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 78/141] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:38 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:38.204285 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4f897231-4a03-4001-9784-7eb4c88c0971 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:38.204901 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4f897231-4a03-4001-9784-7eb4c88c0971 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:38.211132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f897231-4a03-4001-9784-7eb4c88c0971 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:38.211584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f897231-4a03-4001-9784-7eb4c88c0971 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:38.212380 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f897231-4a03-4001-9784-7eb4c88c0971 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:38.212818 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f897231-4a03-4001-9784-7eb4c88c0971 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:38.346279 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4f897231-4a03-4001-9784-7eb4c88c0971 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:38.361471 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4f897231-4a03-4001-9784-7eb4c88c0971 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.161103 Jun 04 18:29:38.362049 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 64/142] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:38 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:38.935173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9a943705-dc58-4b7f-8205-f6af564b57ce tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:38.936560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9a943705-dc58-4b7f-8205-f6af564b57ce tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:38.944240 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a943705-dc58-4b7f-8205-f6af564b57ce tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:38.944754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a943705-dc58-4b7f-8205-f6af564b57ce tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:38.945492 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a943705-dc58-4b7f-8205-f6af564b57ce tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:38.945997 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a943705-dc58-4b7f-8205-f6af564b57ce tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:39.080696 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9a943705-dc58-4b7f-8205-f6af564b57ce tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:39.089469 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9a943705-dc58-4b7f-8205-f6af564b57ce tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.158606 Jun 04 18:29:39.090839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 79/143] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:38 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:39.208657 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0c60a52b-0dc2-4142-88da-3f08314426af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:39.209266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0c60a52b-0dc2-4142-88da-3f08314426af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:39.215667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c60a52b-0dc2-4142-88da-3f08314426af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:39.216934 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c60a52b-0dc2-4142-88da-3f08314426af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:39.217750 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c60a52b-0dc2-4142-88da-3f08314426af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:39.218187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c60a52b-0dc2-4142-88da-3f08314426af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:39.360574 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0c60a52b-0dc2-4142-88da-3f08314426af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:39.368554 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0c60a52b-0dc2-4142-88da-3f08314426af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.169520 Jun 04 18:29:39.369119 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 65/144] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:39 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:39.380060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4ff0efd7-8b37-4ff3-80aa-5146d89612da tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:39.380673 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4ff0efd7-8b37-4ff3-80aa-5146d89612da tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:39.386824 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ff0efd7-8b37-4ff3-80aa-5146d89612da tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:39.387251 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ff0efd7-8b37-4ff3-80aa-5146d89612da tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:39.388754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ff0efd7-8b37-4ff3-80aa-5146d89612da tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:39.389195 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ff0efd7-8b37-4ff3-80aa-5146d89612da tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:39.524357 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ff0efd7-8b37-4ff3-80aa-5146d89612da tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:39.532314 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4ff0efd7-8b37-4ff3-80aa-5146d89612da tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.157684 Jun 04 18:29:39.532890 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 80/145] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:39 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:40.110150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8e3e807e-1ad0-403f-9a52-9c1a6bca7a6d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:40.110666 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8e3e807e-1ad0-403f-9a52-9c1a6bca7a6d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:40.117279 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8e3e807e-1ad0-403f-9a52-9c1a6bca7a6d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:40.117736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8e3e807e-1ad0-403f-9a52-9c1a6bca7a6d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:40.118525 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8e3e807e-1ad0-403f-9a52-9c1a6bca7a6d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:40.118955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8e3e807e-1ad0-403f-9a52-9c1a6bca7a6d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:40.261156 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8e3e807e-1ad0-403f-9a52-9c1a6bca7a6d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:40.268922 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8e3e807e-1ad0-403f-9a52-9c1a6bca7a6d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.163993 Jun 04 18:29:40.269486 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 66/146] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:40 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:40.386070 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c4b5d83e-a48e-4989-9da7-05fea079b905 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:40.386715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c4b5d83e-a48e-4989-9da7-05fea079b905 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:40.393799 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4b5d83e-a48e-4989-9da7-05fea079b905 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:40.394372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4b5d83e-a48e-4989-9da7-05fea079b905 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:40.395162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4b5d83e-a48e-4989-9da7-05fea079b905 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:40.395599 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4b5d83e-a48e-4989-9da7-05fea079b905 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:40.543073 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c4b5d83e-a48e-4989-9da7-05fea079b905 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:40.550070 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-adf57cdf-e29e-4a72-9d75-1a74bd51cb67 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:40.550673 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-adf57cdf-e29e-4a72-9d75-1a74bd51cb67 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:40.550774 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c4b5d83e-a48e-4989-9da7-05fea079b905 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.168658 Jun 04 18:29:40.551251 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 81/147] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:40 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:40.557027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-adf57cdf-e29e-4a72-9d75-1a74bd51cb67 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:40.557473 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-adf57cdf-e29e-4a72-9d75-1a74bd51cb67 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:40.558222 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-adf57cdf-e29e-4a72-9d75-1a74bd51cb67 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:40.558849 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-adf57cdf-e29e-4a72-9d75-1a74bd51cb67 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:40.705742 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-adf57cdf-e29e-4a72-9d75-1a74bd51cb67 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:40.713361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-adf57cdf-e29e-4a72-9d75-1a74bd51cb67 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.167099 Jun 04 18:29:40.713907 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 67/148] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:40 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:41.286820 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-22486f5a-b216-4638-a746-2c1e4f7ef5cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:41.287424 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-22486f5a-b216-4638-a746-2c1e4f7ef5cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:41.294073 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-22486f5a-b216-4638-a746-2c1e4f7ef5cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:41.294524 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-22486f5a-b216-4638-a746-2c1e4f7ef5cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:41.295276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-22486f5a-b216-4638-a746-2c1e4f7ef5cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:41.295726 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-22486f5a-b216-4638-a746-2c1e4f7ef5cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:41.568169 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f3f4f4cb-811f-44ad-9567-05fc9f7d51c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:41.569418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f3f4f4cb-811f-44ad-9567-05fc9f7d51c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:41.575889 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3f4f4cb-811f-44ad-9567-05fc9f7d51c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:41.576453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3f4f4cb-811f-44ad-9567-05fc9f7d51c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:41.577478 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3f4f4cb-811f-44ad-9567-05fc9f7d51c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:41.578028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3f4f4cb-811f-44ad-9567-05fc9f7d51c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:41.592529 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-22486f5a-b216-4638-a746-2c1e4f7ef5cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:41.597459 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-22486f5a-b216-4638-a746-2c1e4f7ef5cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.314496 Jun 04 18:29:41.598026 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 82/149] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:41 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:41.709545 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f3f4f4cb-811f-44ad-9567-05fc9f7d51c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:41.717456 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f3f4f4cb-811f-44ad-9567-05fc9f7d51c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.153811 Jun 04 18:29:41.718249 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 68/150] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:41 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:41.730166 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-24b6d177-d378-4764-b26a-c105977c55e8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:41.730904 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-24b6d177-d378-4764-b26a-c105977c55e8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:41.737508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24b6d177-d378-4764-b26a-c105977c55e8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:41.737957 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24b6d177-d378-4764-b26a-c105977c55e8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:41.738727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24b6d177-d378-4764-b26a-c105977c55e8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:41.739139 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24b6d177-d378-4764-b26a-c105977c55e8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:41.878679 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-24b6d177-d378-4764-b26a-c105977c55e8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:41.885979 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-24b6d177-d378-4764-b26a-c105977c55e8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.159646 Jun 04 18:29:41.886546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 83/151] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:41 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:42.618527 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e5cb0a04-18d2-42a8-a430-9369f6120802 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:42.619664 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e5cb0a04-18d2-42a8-a430-9369f6120802 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:42.628050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e5cb0a04-18d2-42a8-a430-9369f6120802 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:42.628523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e5cb0a04-18d2-42a8-a430-9369f6120802 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:42.629296 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e5cb0a04-18d2-42a8-a430-9369f6120802 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:42.629729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e5cb0a04-18d2-42a8-a430-9369f6120802 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:42.734796 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2ba91b94-1ac9-4a3c-9755-bf91adeae9b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:42.735377 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2ba91b94-1ac9-4a3c-9755-bf91adeae9b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:42.741839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ba91b94-1ac9-4a3c-9755-bf91adeae9b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:42.742286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ba91b94-1ac9-4a3c-9755-bf91adeae9b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:42.743048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ba91b94-1ac9-4a3c-9755-bf91adeae9b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:42.743485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ba91b94-1ac9-4a3c-9755-bf91adeae9b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:42.766058 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e5cb0a04-18d2-42a8-a430-9369f6120802 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:42.774261 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e5cb0a04-18d2-42a8-a430-9369f6120802 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.162118 Jun 04 18:29:42.774854 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 69/152] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:42 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:42.903472 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ed62c6b9-0c1d-4962-bb8c-a04c593bb074 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:42.903988 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ed62c6b9-0c1d-4962-bb8c-a04c593bb074 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:42.912325 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed62c6b9-0c1d-4962-bb8c-a04c593bb074 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:42.913269 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed62c6b9-0c1d-4962-bb8c-a04c593bb074 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:42.913345 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:42.913541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed62c6b9-0c1d-4962-bb8c-a04c593bb074 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:42.913952 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed62c6b9-0c1d-4962-bb8c-a04c593bb074 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:43.059668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2ba91b94-1ac9-4a3c-9755-bf91adeae9b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:43.070487 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2ba91b94-1ac9-4a3c-9755-bf91adeae9b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.339470 Jun 04 18:29:43.071131 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 84/153] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:42 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:43.211756 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ed62c6b9-0c1d-4962-bb8c-a04c593bb074 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:43.219774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ed62c6b9-0c1d-4962-bb8c-a04c593bb074 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.320332 Jun 04 18:29:43.220350 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 70/154] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:42 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:43.791277 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3285aa7f-a56a-45bb-b7cc-29cb390b888b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:43.792543 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3285aa7f-a56a-45bb-b7cc-29cb390b888b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:43.798809 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3285aa7f-a56a-45bb-b7cc-29cb390b888b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:43.799337 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3285aa7f-a56a-45bb-b7cc-29cb390b888b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:43.800211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3285aa7f-a56a-45bb-b7cc-29cb390b888b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:43.800807 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3285aa7f-a56a-45bb-b7cc-29cb390b888b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:43.972919 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3285aa7f-a56a-45bb-b7cc-29cb390b888b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:43.981697 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3285aa7f-a56a-45bb-b7cc-29cb390b888b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.194643 Jun 04 18:29:43.982272 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 85/155] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:43 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:44.090113 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c0a21ad6-8a73-41ac-8a90-369c07cb0663 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:44.091640 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c0a21ad6-8a73-41ac-8a90-369c07cb0663 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:44.099176 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c0a21ad6-8a73-41ac-8a90-369c07cb0663 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:44.100123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c0a21ad6-8a73-41ac-8a90-369c07cb0663 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:44.107571 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c0a21ad6-8a73-41ac-8a90-369c07cb0663 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:44.108402 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c0a21ad6-8a73-41ac-8a90-369c07cb0663 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:44.236884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a012bd9e-52b0-4629-814a-6a6834fb1e36 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:44.237742 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a012bd9e-52b0-4629-814a-6a6834fb1e36 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:44.245174 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a012bd9e-52b0-4629-814a-6a6834fb1e36 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:44.245982 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a012bd9e-52b0-4629-814a-6a6834fb1e36 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:44.247542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a012bd9e-52b0-4629-814a-6a6834fb1e36 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:44.248158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a012bd9e-52b0-4629-814a-6a6834fb1e36 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:44.378756 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c0a21ad6-8a73-41ac-8a90-369c07cb0663 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:44.387752 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:44.393589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c0a21ad6-8a73-41ac-8a90-369c07cb0663 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.308073 Jun 04 18:29:44.394913 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 71/156] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:44 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:44.522899 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a012bd9e-52b0-4629-814a-6a6834fb1e36 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:44.531754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a012bd9e-52b0-4629-814a-6a6834fb1e36 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.299630 Jun 04 18:29:44.532716 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 86/157] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:44 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:44.998964 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7c3c8d2e-4cbd-4b65-91a2-0e38831686a9 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:44.999775 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7c3c8d2e-4cbd-4b65-91a2-0e38831686a9 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:45.006607 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c3c8d2e-4cbd-4b65-91a2-0e38831686a9 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:45.007057 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c3c8d2e-4cbd-4b65-91a2-0e38831686a9 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:45.007823 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c3c8d2e-4cbd-4b65-91a2-0e38831686a9 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:45.008443 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c3c8d2e-4cbd-4b65-91a2-0e38831686a9 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:45.167006 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7c3c8d2e-4cbd-4b65-91a2-0e38831686a9 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:45.178290 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7c3c8d2e-4cbd-4b65-91a2-0e38831686a9 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1315 microversion: 2.1 time: 0.183131 Jun 04 18:29:45.179141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 72/158] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:44 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:45.412343 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e33046a5-159e-46cf-b51b-1dd57f0da4b0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:45.412928 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e33046a5-159e-46cf-b51b-1dd57f0da4b0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:45.423500 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e33046a5-159e-46cf-b51b-1dd57f0da4b0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:45.424231 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e33046a5-159e-46cf-b51b-1dd57f0da4b0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:45.427293 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e33046a5-159e-46cf-b51b-1dd57f0da4b0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:45.427736 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e33046a5-159e-46cf-b51b-1dd57f0da4b0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:45.531736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-c15d5fe3-da6a-4b7e-90c9-e363b2add20d req-77814b3b-012c-4a02-92b1-24dd51f641d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ac4261-d93e-474e-84f7-9941b02a97c3", "name": "network-vif-plugged", "status": "completed", "tag": "dceed2f4-0207-4e67-bd10-c14cc090441a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:45.550551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c15d5fe3-da6a-4b7e-90c9-e363b2add20d req-77814b3b-012c-4a02-92b1-24dd51f641d1 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:45.552496 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c15d5fe3-da6a-4b7e-90c9-e363b2add20d req-77814b3b-012c-4a02-92b1-24dd51f641d1 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:45.585421 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-c15d5fe3-da6a-4b7e-90c9-e363b2add20d req-77814b3b-012c-4a02-92b1-24dd51f641d1 service nova] Creating event network-vif-plugged:dceed2f4-0207-4e67-bd10-c14cc090441a for instance 84ac4261-d93e-474e-84f7-9941b02a97c3 on hv-cinder-79053 Jun 04 18:29:45.595597 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-c15d5fe3-da6a-4b7e-90c9-e363b2add20d req-77814b3b-012c-4a02-92b1-24dd51f641d1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068903 Jun 04 18:29:45.599200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 73/159] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:29:45.610049 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5f1cb36c-f48f-4844-96fa-329d60005346 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:45.614254 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5f1cb36c-f48f-4844-96fa-329d60005346 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:45.639841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f1cb36c-f48f-4844-96fa-329d60005346 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:45.642089 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f1cb36c-f48f-4844-96fa-329d60005346 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:45.643802 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f1cb36c-f48f-4844-96fa-329d60005346 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:45.645540 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f1cb36c-f48f-4844-96fa-329d60005346 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:45.663043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e33046a5-159e-46cf-b51b-1dd57f0da4b0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:45.679019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e33046a5-159e-46cf-b51b-1dd57f0da4b0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.270322 Jun 04 18:29:45.679918 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 87/160] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:45 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:45.923535 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5f1cb36c-f48f-4844-96fa-329d60005346 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:45.940553 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5f1cb36c-f48f-4844-96fa-329d60005346 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.335192 Jun 04 18:29:45.951955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 74/161] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:45 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:46.201362 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b20f8f7e-f340-4acd-9a82-e882697b99e8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:46.202319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b20f8f7e-f340-4acd-9a82-e882697b99e8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:46.216776 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b20f8f7e-f340-4acd-9a82-e882697b99e8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:46.217274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b20f8f7e-f340-4acd-9a82-e882697b99e8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:46.219326 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b20f8f7e-f340-4acd-9a82-e882697b99e8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:46.219779 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b20f8f7e-f340-4acd-9a82-e882697b99e8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:46.439381 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b20f8f7e-f340-4acd-9a82-e882697b99e8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:46.453331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b20f8f7e-f340-4acd-9a82-e882697b99e8 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1501 microversion: 2.1 time: 0.260541 Jun 04 18:29:46.455155 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 88/162] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:46 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1501 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:46.699644 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b12d2d98-cc53-412f-b758-7f432b12b42c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:46.701280 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b12d2d98-cc53-412f-b758-7f432b12b42c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:46.708720 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b12d2d98-cc53-412f-b758-7f432b12b42c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:46.709499 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b12d2d98-cc53-412f-b758-7f432b12b42c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:46.710921 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b12d2d98-cc53-412f-b758-7f432b12b42c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:46.711670 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b12d2d98-cc53-412f-b758-7f432b12b42c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:46.957730 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0132390e-6f76-47c0-8b78-f581089f6533 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:46.958323 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0132390e-6f76-47c0-8b78-f581089f6533 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:46.962694 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b12d2d98-cc53-412f-b758-7f432b12b42c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:46.966874 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0132390e-6f76-47c0-8b78-f581089f6533 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:46.967325 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0132390e-6f76-47c0-8b78-f581089f6533 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:46.968465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0132390e-6f76-47c0-8b78-f581089f6533 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:46.968799 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0132390e-6f76-47c0-8b78-f581089f6533 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:46.972514 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b12d2d98-cc53-412f-b758-7f432b12b42c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.278975 Jun 04 18:29:46.973719 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 75/163] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:46 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:47.131640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0132390e-6f76-47c0-8b78-f581089f6533 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:47.142043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0132390e-6f76-47c0-8b78-f581089f6533 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.188094 Jun 04 18:29:47.142955 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 89/164] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:46 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:47.937146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-afb64b2b-70f1-44da-8448-84e081b37979 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "051c9e40-142c-4747-872c-273d829c93ab"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:47.941283 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-afb64b2b-70f1-44da-8448-84e081b37979 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:47.941283 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=76 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:47.946316 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afb64b2b-70f1-44da-8448-84e081b37979 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:47.946771 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afb64b2b-70f1-44da-8448-84e081b37979 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:47.947544 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afb64b2b-70f1-44da-8448-84e081b37979 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:47.948046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afb64b2b-70f1-44da-8448-84e081b37979 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:47.989448 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e3d2927f-7de1-4257-8099-942bd841e437 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:47.990056 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e3d2927f-7de1-4257-8099-942bd841e437 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:48.003767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3d2927f-7de1-4257-8099-942bd841e437 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:48.004528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3d2927f-7de1-4257-8099-942bd841e437 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:48.005792 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3d2927f-7de1-4257-8099-942bd841e437 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:48.006434 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3d2927f-7de1-4257-8099-942bd841e437 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:48.278429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e3d2927f-7de1-4257-8099-942bd841e437 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:48.293024 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e3d2927f-7de1-4257-8099-942bd841e437 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.306922 Jun 04 18:29:48.293024 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 90/165] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:47 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:48.303649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-60617179-c404-4ca3-b3aa-a59c87bc9ab2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:48.304486 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-60617179-c404-4ca3-b3aa-a59c87bc9ab2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:48.325839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-60617179-c404-4ca3-b3aa-a59c87bc9ab2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:48.328613 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-60617179-c404-4ca3-b3aa-a59c87bc9ab2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:48.329623 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-60617179-c404-4ca3-b3aa-a59c87bc9ab2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:48.330380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-60617179-c404-4ca3-b3aa-a59c87bc9ab2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:48.587490 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-60617179-c404-4ca3-b3aa-a59c87bc9ab2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:48.609431 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-60617179-c404-4ca3-b3aa-a59c87bc9ab2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.312020 Jun 04 18:29:48.610213 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 91/166] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:48 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:48.912886 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-afb64b2b-70f1-44da-8448-84e081b37979 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "POST /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.979344 Jun 04 18:29:48.920301 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 76/167] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:29:47 2022] POST /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:49.322728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-14f821a3-8508-435a-94f1-b484b40e189b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:49.323344 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-14f821a3-8508-435a-94f1-b484b40e189b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:49.338475 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14f821a3-8508-435a-94f1-b484b40e189b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:49.338931 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14f821a3-8508-435a-94f1-b484b40e189b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:49.339705 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14f821a3-8508-435a-94f1-b484b40e189b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:49.340172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14f821a3-8508-435a-94f1-b484b40e189b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:49.528945 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-14f821a3-8508-435a-94f1-b484b40e189b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:49.537224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-14f821a3-8508-435a-94f1-b484b40e189b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.227506 Jun 04 18:29:49.538050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 92/168] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:49 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:49.628846 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dad458f8-c9a4-4b8d-be1a-58a9ce03bfe2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:49.629718 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dad458f8-c9a4-4b8d-be1a-58a9ce03bfe2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:49.637609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dad458f8-c9a4-4b8d-be1a-58a9ce03bfe2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:49.638746 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dad458f8-c9a4-4b8d-be1a-58a9ce03bfe2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:49.639790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dad458f8-c9a4-4b8d-be1a-58a9ce03bfe2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:49.640320 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dad458f8-c9a4-4b8d-be1a-58a9ce03bfe2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:49.801914 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dad458f8-c9a4-4b8d-be1a-58a9ce03bfe2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:49.813763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dad458f8-c9a4-4b8d-be1a-58a9ce03bfe2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.190715 Jun 04 18:29:49.815101 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 77/169] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:49 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:50.554994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1c02b7ca-676c-4d99-a3ee-bbb29b24378a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:50.556375 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1c02b7ca-676c-4d99-a3ee-bbb29b24378a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:50.561916 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=80 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:50.563566 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c02b7ca-676c-4d99-a3ee-bbb29b24378a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:50.564376 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c02b7ca-676c-4d99-a3ee-bbb29b24378a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:50.565854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c02b7ca-676c-4d99-a3ee-bbb29b24378a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:50.566734 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c02b7ca-676c-4d99-a3ee-bbb29b24378a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:50.754626 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1c02b7ca-676c-4d99-a3ee-bbb29b24378a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:50.762748 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1c02b7ca-676c-4d99-a3ee-bbb29b24378a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.211817 Jun 04 18:29:50.763319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 93/170] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:50 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:29:50.836761 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7748840d-68c8-46f8-a68c-0c967a3907ff tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:50.839845 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7748840d-68c8-46f8-a68c-0c967a3907ff tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:50.851179 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7748840d-68c8-46f8-a68c-0c967a3907ff tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:50.851634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7748840d-68c8-46f8-a68c-0c967a3907ff tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:50.852589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7748840d-68c8-46f8-a68c-0c967a3907ff tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:50.853184 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7748840d-68c8-46f8-a68c-0c967a3907ff tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:51.023044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7748840d-68c8-46f8-a68c-0c967a3907ff tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:51.034175 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7748840d-68c8-46f8-a68c-0c967a3907ff tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1362 microversion: 2.1 time: 0.207210 Jun 04 18:29:51.034783 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 78/171] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:50 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:51.402046 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-d49a6c3a-d06f-4bc2-a48f-454abc3fc03f req-15a21b78-e9f6-434a-8641-327d2c5dc68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ade342-ad6d-48d1-909f-5f7530d99dbe", "name": "network-vif-plugged", "status": "completed", "tag": "f05c89f1-fde1-490d-acf9-e0339f649264"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:51.421272 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d49a6c3a-d06f-4bc2-a48f-454abc3fc03f req-15a21b78-e9f6-434a-8641-327d2c5dc68d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:51.423196 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d49a6c3a-d06f-4bc2-a48f-454abc3fc03f req-15a21b78-e9f6-434a-8641-327d2c5dc68d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:51.454835 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-d49a6c3a-d06f-4bc2-a48f-454abc3fc03f req-15a21b78-e9f6-434a-8641-327d2c5dc68d service nova] Creating event network-vif-plugged:f05c89f1-fde1-490d-acf9-e0339f649264 for instance 43ade342-ad6d-48d1-909f-5f7530d99dbe on hv-cinder-79053 Jun 04 18:29:51.470765 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-d49a6c3a-d06f-4bc2-a48f-454abc3fc03f req-15a21b78-e9f6-434a-8641-327d2c5dc68d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072220 Jun 04 18:29:51.471397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 94/172] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:51.781605 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0ef86b30-0d78-47ae-9578-d76fad3df96d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:51.782315 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0ef86b30-0d78-47ae-9578-d76fad3df96d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:51.789492 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ef86b30-0d78-47ae-9578-d76fad3df96d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:51.790288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ef86b30-0d78-47ae-9578-d76fad3df96d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:51.791258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ef86b30-0d78-47ae-9578-d76fad3df96d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:51.791690 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ef86b30-0d78-47ae-9578-d76fad3df96d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:51.946373 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0ef86b30-0d78-47ae-9578-d76fad3df96d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:51.954324 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0ef86b30-0d78-47ae-9578-d76fad3df96d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.178355 Jun 04 18:29:51.963920 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 79/173] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:51 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:52.054237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c7fa29f4-806a-4f3a-87ba-642b4698ab73 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:52.054909 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c7fa29f4-806a-4f3a-87ba-642b4698ab73 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:52.061560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7fa29f4-806a-4f3a-87ba-642b4698ab73 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:52.062190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7fa29f4-806a-4f3a-87ba-642b4698ab73 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:52.063060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7fa29f4-806a-4f3a-87ba-642b4698ab73 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:52.063500 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7fa29f4-806a-4f3a-87ba-642b4698ab73 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:52.219849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c7fa29f4-806a-4f3a-87ba-642b4698ab73 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:52.227447 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c7fa29f4-806a-4f3a-87ba-642b4698ab73 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1548 microversion: 2.1 time: 0.178882 Jun 04 18:29:52.228282 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 95/174] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:52 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:52.244757 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-936f2252-be07-4730-b725-ae0739e56d0f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:52.245251 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-936f2252-be07-4730-b725-ae0739e56d0f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:52.251487 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-936f2252-be07-4730-b725-ae0739e56d0f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:52.251936 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-936f2252-be07-4730-b725-ae0739e56d0f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:52.252738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-936f2252-be07-4730-b725-ae0739e56d0f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:52.253175 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-936f2252-be07-4730-b725-ae0739e56d0f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:52.331758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-936f2252-be07-4730-b725-ae0739e56d0f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090836 Jun 04 18:29:52.332358 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 80/175] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 4 18:29:52 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:52.971771 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-868d35e8-8afd-411f-81b2-474a7e2b4c6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:52.972519 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-868d35e8-8afd-411f-81b2-474a7e2b4c6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:52.979880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-868d35e8-8afd-411f-81b2-474a7e2b4c6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:52.980429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-868d35e8-8afd-411f-81b2-474a7e2b4c6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:52.981315 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-868d35e8-8afd-411f-81b2-474a7e2b4c6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:52.981814 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-868d35e8-8afd-411f-81b2-474a7e2b4c6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:53.126031 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-868d35e8-8afd-411f-81b2-474a7e2b4c6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:53.135615 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-868d35e8-8afd-411f-81b2-474a7e2b4c6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.167948 Jun 04 18:29:53.136245 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 96/176] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:52 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:53.736786 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-2b6fb6b3-aa8f-4ca8-b380-882f29aee477 req-98e276ca-5696-448a-8b3c-90f10f09c75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ac4261-d93e-474e-84f7-9941b02a97c3", "tag": "dceed2f4-0207-4e67-bd10-c14cc090441a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:53.747269 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-2b6fb6b3-aa8f-4ca8-b380-882f29aee477 req-98e276ca-5696-448a-8b3c-90f10f09c75a service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:53.747758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-2b6fb6b3-aa8f-4ca8-b380-882f29aee477 req-98e276ca-5696-448a-8b3c-90f10f09c75a service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:53.760111 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-2b6fb6b3-aa8f-4ca8-b380-882f29aee477 req-98e276ca-5696-448a-8b3c-90f10f09c75a service nova] Creating event network-changed:dceed2f4-0207-4e67-bd10-c14cc090441a for instance 84ac4261-d93e-474e-84f7-9941b02a97c3 on hv-cinder-79053 Jun 04 18:29:53.765504 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-2b6fb6b3-aa8f-4ca8-b380-882f29aee477 req-98e276ca-5696-448a-8b3c-90f10f09c75a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033674 Jun 04 18:29:53.766109 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 81/177] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:29:54.152193 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9a0cc8ed-887f-48b4-a16f-681fb9b89a83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:54.152795 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9a0cc8ed-887f-48b4-a16f-681fb9b89a83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:54.160248 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a0cc8ed-887f-48b4-a16f-681fb9b89a83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:54.160943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a0cc8ed-887f-48b4-a16f-681fb9b89a83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:54.161722 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a0cc8ed-887f-48b4-a16f-681fb9b89a83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:54.162371 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a0cc8ed-887f-48b4-a16f-681fb9b89a83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:54.354446 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9a0cc8ed-887f-48b4-a16f-681fb9b89a83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:54.362306 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9a0cc8ed-887f-48b4-a16f-681fb9b89a83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.213947 Jun 04 18:29:54.362888 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 97/178] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:54 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:55.380193 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1f2c5a5f-2943-455e-8c4a-edb18c2a477a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:55.380920 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1f2c5a5f-2943-455e-8c4a-edb18c2a477a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:55.387513 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f2c5a5f-2943-455e-8c4a-edb18c2a477a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:55.388113 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f2c5a5f-2943-455e-8c4a-edb18c2a477a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:55.388912 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f2c5a5f-2943-455e-8c4a-edb18c2a477a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:55.389356 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f2c5a5f-2943-455e-8c4a-edb18c2a477a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:55.526269 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1f2c5a5f-2943-455e-8c4a-edb18c2a477a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:55.534196 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1f2c5a5f-2943-455e-8c4a-edb18c2a477a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.158653 Jun 04 18:29:55.534790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 82/179] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:55 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:56.552696 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-28005c99-2040-49cc-a54e-462dacbeccbd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:56.553368 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-28005c99-2040-49cc-a54e-462dacbeccbd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:56.560614 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28005c99-2040-49cc-a54e-462dacbeccbd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:56.561062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28005c99-2040-49cc-a54e-462dacbeccbd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:56.562053 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28005c99-2040-49cc-a54e-462dacbeccbd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:56.562550 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28005c99-2040-49cc-a54e-462dacbeccbd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:56.774186 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-28005c99-2040-49cc-a54e-462dacbeccbd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:56.784275 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-28005c99-2040-49cc-a54e-462dacbeccbd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1322 microversion: 2.1 time: 0.236000 Jun 04 18:29:56.785827 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 98/180] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:56 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:57.804618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02b859ff-14fe-47f3-8807-0b0f3052ee9d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:57.805351 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02b859ff-14fe-47f3-8807-0b0f3052ee9d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:57.819124 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02b859ff-14fe-47f3-8807-0b0f3052ee9d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:57.819866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02b859ff-14fe-47f3-8807-0b0f3052ee9d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:57.820793 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02b859ff-14fe-47f3-8807-0b0f3052ee9d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:57.821363 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02b859ff-14fe-47f3-8807-0b0f3052ee9d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:57.965822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02b859ff-14fe-47f3-8807-0b0f3052ee9d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:57.973571 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02b859ff-14fe-47f3-8807-0b0f3052ee9d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1517 microversion: 2.1 time: 0.175159 Jun 04 18:29:57.974146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 83/181] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:57 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:57.992472 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d7bc0157-6eda-4b59-94a3-adf4c7bae14c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:29:57.993643 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d7bc0157-6eda-4b59-94a3-adf4c7bae14c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:58.000294 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7bc0157-6eda-4b59-94a3-adf4c7bae14c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:58.001300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7bc0157-6eda-4b59-94a3-adf4c7bae14c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:58.002565 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7bc0157-6eda-4b59-94a3-adf4c7bae14c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:58.003236 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7bc0157-6eda-4b59-94a3-adf4c7bae14c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:58.074121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-d7bc0157-6eda-4b59-94a3-adf4c7bae14c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lazy-loading 'flavor' on Instance uuid 43ade342-ad6d-48d1-909f-5f7530d99dbe {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:29:58.189078 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:58.210658 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d7bc0157-6eda-4b59-94a3-adf4c7bae14c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe/action" status: 200 len: 32 microversion: 2.1 time: 0.223995 Jun 04 18:29:58.211684 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 99/182] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:29:57 2022] POST /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:29:58.222305 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-317b97d3-d5b0-4a47-bd50-1eee80f8e00b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:58.226729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-317b97d3-d5b0-4a47-bd50-1eee80f8e00b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:58.236787 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-317b97d3-d5b0-4a47-bd50-1eee80f8e00b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:58.238350 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-317b97d3-d5b0-4a47-bd50-1eee80f8e00b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:58.239492 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-317b97d3-d5b0-4a47-bd50-1eee80f8e00b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:58.240300 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-317b97d3-d5b0-4a47-bd50-1eee80f8e00b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:58.585011 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-317b97d3-d5b0-4a47-bd50-1eee80f8e00b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:58.606854 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-317b97d3-d5b0-4a47-bd50-1eee80f8e00b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.390162 Jun 04 18:29:58.608603 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 84/183] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:58 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:29:59.630209 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e7a7c6d1-6230-4855-bd36-7fc9a5dd526c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:29:59.631325 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e7a7c6d1-6230-4855-bd36-7fc9a5dd526c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:29:59.641484 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7a7c6d1-6230-4855-bd36-7fc9a5dd526c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:59.641919 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7a7c6d1-6230-4855-bd36-7fc9a5dd526c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:59.642673 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7a7c6d1-6230-4855-bd36-7fc9a5dd526c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:29:59.643100 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7a7c6d1-6230-4855-bd36-7fc9a5dd526c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:29:59.844580 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e7a7c6d1-6230-4855-bd36-7fc9a5dd526c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:29:59.858080 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e7a7c6d1-6230-4855-bd36-7fc9a5dd526c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.230420 Jun 04 18:29:59.858080 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 100/184] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:29:59 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:00.873489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1fe75b71-052a-4734-b697-ca0e26907e54 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:00.874531 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1fe75b71-052a-4734-b697-ca0e26907e54 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:00.885626 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1fe75b71-052a-4734-b697-ca0e26907e54 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:00.886355 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1fe75b71-052a-4734-b697-ca0e26907e54 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:00.887674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1fe75b71-052a-4734-b697-ca0e26907e54 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:00.888482 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1fe75b71-052a-4734-b697-ca0e26907e54 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:01.018034 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1fe75b71-052a-4734-b697-ca0e26907e54 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:01.029559 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1fe75b71-052a-4734-b697-ca0e26907e54 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.162257 Jun 04 18:30:01.030414 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 85/185] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:00 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:02.047686 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-69ea9ce5-5316-436a-b2ae-8fad5a40e29d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:02.048350 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-69ea9ce5-5316-436a-b2ae-8fad5a40e29d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:02.054734 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-69ea9ce5-5316-436a-b2ae-8fad5a40e29d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:02.055164 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-69ea9ce5-5316-436a-b2ae-8fad5a40e29d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:02.055924 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-69ea9ce5-5316-436a-b2ae-8fad5a40e29d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:02.056385 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-69ea9ce5-5316-436a-b2ae-8fad5a40e29d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:02.219250 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-69ea9ce5-5316-436a-b2ae-8fad5a40e29d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:02.227520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-69ea9ce5-5316-436a-b2ae-8fad5a40e29d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.183663 Jun 04 18:30:02.228106 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 101/186] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:02 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:03.246775 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dfd5c766-55ec-42a7-b8ce-6fb45c99ff10 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:03.247478 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dfd5c766-55ec-42a7-b8ce-6fb45c99ff10 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:03.256782 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfd5c766-55ec-42a7-b8ce-6fb45c99ff10 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:03.257234 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfd5c766-55ec-42a7-b8ce-6fb45c99ff10 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:03.258828 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfd5c766-55ec-42a7-b8ce-6fb45c99ff10 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:03.259443 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfd5c766-55ec-42a7-b8ce-6fb45c99ff10 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:03.405498 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dfd5c766-55ec-42a7-b8ce-6fb45c99ff10 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:03.414073 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dfd5c766-55ec-42a7-b8ce-6fb45c99ff10 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.173494 Jun 04 18:30:03.415000 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 86/187] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:03 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:04.431664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4e038ca6-238a-41c4-bab2-527b7ad5f6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:04.432356 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4e038ca6-238a-41c4-bab2-527b7ad5f6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:04.439602 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e038ca6-238a-41c4-bab2-527b7ad5f6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:04.439602 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e038ca6-238a-41c4-bab2-527b7ad5f6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:04.440437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e038ca6-238a-41c4-bab2-527b7ad5f6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:04.440891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e038ca6-238a-41c4-bab2-527b7ad5f6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:04.578331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4e038ca6-238a-41c4-bab2-527b7ad5f6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:04.586497 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4e038ca6-238a-41c4-bab2-527b7ad5f6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.158783 Jun 04 18:30:04.587094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 102/188] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:04 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:05.604930 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0c97d5e8-8a1e-4250-a391-2d3ed69a1197 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:05.605620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0c97d5e8-8a1e-4250-a391-2d3ed69a1197 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:05.613865 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c97d5e8-8a1e-4250-a391-2d3ed69a1197 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:05.614310 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c97d5e8-8a1e-4250-a391-2d3ed69a1197 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:05.615076 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c97d5e8-8a1e-4250-a391-2d3ed69a1197 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:05.615502 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c97d5e8-8a1e-4250-a391-2d3ed69a1197 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:05.814999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0c97d5e8-8a1e-4250-a391-2d3ed69a1197 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:05.822882 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0c97d5e8-8a1e-4250-a391-2d3ed69a1197 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.222121 Jun 04 18:30:05.823720 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 87/189] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:05 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:06.842749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-83b92d66-cf57-4a6e-afe1-9ad4469fe58a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:06.843632 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-83b92d66-cf57-4a6e-afe1-9ad4469fe58a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:06.850281 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-83b92d66-cf57-4a6e-afe1-9ad4469fe58a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:06.850732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-83b92d66-cf57-4a6e-afe1-9ad4469fe58a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:06.851500 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-83b92d66-cf57-4a6e-afe1-9ad4469fe58a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:06.851940 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-83b92d66-cf57-4a6e-afe1-9ad4469fe58a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:07.220174 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-83b92d66-cf57-4a6e-afe1-9ad4469fe58a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:07.227774 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-83b92d66-cf57-4a6e-afe1-9ad4469fe58a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.389034 Jun 04 18:30:07.228380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 103/190] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:06 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:08.253175 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3876acf6-af2e-47c0-9d67-784e0e6a627b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:08.253929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3876acf6-af2e-47c0-9d67-784e0e6a627b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:08.260090 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3876acf6-af2e-47c0-9d67-784e0e6a627b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:08.260764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3876acf6-af2e-47c0-9d67-784e0e6a627b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:08.261720 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3876acf6-af2e-47c0-9d67-784e0e6a627b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:08.262190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3876acf6-af2e-47c0-9d67-784e0e6a627b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:08.415971 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3876acf6-af2e-47c0-9d67-784e0e6a627b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:08.418390 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:08.425593 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3876acf6-af2e-47c0-9d67-784e0e6a627b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.183850 Jun 04 18:30:08.426178 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 88/191] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:08 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:09.297524 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7fc6a924-a7e5-43fe-bcfc-914b3fcb31a4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:09.298019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7fc6a924-a7e5-43fe-bcfc-914b3fcb31a4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:09.305067 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fc6a924-a7e5-43fe-bcfc-914b3fcb31a4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:09.305508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fc6a924-a7e5-43fe-bcfc-914b3fcb31a4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:09.306270 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fc6a924-a7e5-43fe-bcfc-914b3fcb31a4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:09.306701 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fc6a924-a7e5-43fe-bcfc-914b3fcb31a4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:09.333679 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7fc6a924-a7e5-43fe-bcfc-914b3fcb31a4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:30:09.428988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7fc6a924-a7e5-43fe-bcfc-914b3fcb31a4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "DELETE /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 204 len: 0 microversion: 2.1 time: 0.134578 Jun 04 18:30:09.430322 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 104/192] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:30:09 2022] DELETE /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:30:09.441799 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d694e096-75e5-4dd4-a650-af1b7d5485a0 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:09.442420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d694e096-75e5-4dd4-a650-af1b7d5485a0 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:09.449415 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d694e096-75e5-4dd4-a650-af1b7d5485a0 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:09.450637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d694e096-75e5-4dd4-a650-af1b7d5485a0 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:09.451240 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a7d45974-90aa-4bbd-ae41-6b6836ec465a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:09.451485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d694e096-75e5-4dd4-a650-af1b7d5485a0 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:09.452093 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d694e096-75e5-4dd4-a650-af1b7d5485a0 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:09.452224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a7d45974-90aa-4bbd-ae41-6b6836ec465a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:09.458755 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a7d45974-90aa-4bbd-ae41-6b6836ec465a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:09.460578 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a7d45974-90aa-4bbd-ae41-6b6836ec465a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:09.461474 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a7d45974-90aa-4bbd-ae41-6b6836ec465a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:09.462235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a7d45974-90aa-4bbd-ae41-6b6836ec465a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:09.603857 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d694e096-75e5-4dd4-a650-af1b7d5485a0 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:09.608042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d694e096-75e5-4dd4-a650-af1b7d5485a0 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1553 microversion: 2.1 time: 0.173068 Jun 04 18:30:09.608621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 89/193] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:09 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:09.620223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a7d45974-90aa-4bbd-ae41-6b6836ec465a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:09.629033 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a7d45974-90aa-4bbd-ae41-6b6836ec465a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.189848 Jun 04 18:30:09.629688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 105/194] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:09 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:30:10.625580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-34e16550-23ff-42ee-935a-e8090a381fc7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:10.626166 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-34e16550-23ff-42ee-935a-e8090a381fc7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:10.633810 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-34e16550-23ff-42ee-935a-e8090a381fc7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:10.634259 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-34e16550-23ff-42ee-935a-e8090a381fc7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:10.635036 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-34e16550-23ff-42ee-935a-e8090a381fc7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:10.635466 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-34e16550-23ff-42ee-935a-e8090a381fc7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:10.646828 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-da7a571f-5e94-4f95-a771-6bfc4b4c5fb3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:10.647445 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-da7a571f-5e94-4f95-a771-6bfc4b4c5fb3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:10.660501 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da7a571f-5e94-4f95-a771-6bfc4b4c5fb3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:10.660958 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da7a571f-5e94-4f95-a771-6bfc4b4c5fb3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:10.661754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da7a571f-5e94-4f95-a771-6bfc4b4c5fb3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:10.662237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da7a571f-5e94-4f95-a771-6bfc4b4c5fb3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:10.798944 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-34e16550-23ff-42ee-935a-e8090a381fc7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:10.812233 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-34e16550-23ff-42ee-935a-e8090a381fc7 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1553 microversion: 2.1 time: 0.189383 Jun 04 18:30:10.812233 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 90/195] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:10 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:10.857411 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-da7a571f-5e94-4f95-a771-6bfc4b4c5fb3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:10.865242 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-da7a571f-5e94-4f95-a771-6bfc4b4c5fb3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.222580 Jun 04 18:30:10.866098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 106/196] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:10 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:30:11.828470 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d6d24ece-5f1d-443a-8072-9abe960b0b0c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:11.829060 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d6d24ece-5f1d-443a-8072-9abe960b0b0c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:11.835600 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6d24ece-5f1d-443a-8072-9abe960b0b0c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:11.836125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6d24ece-5f1d-443a-8072-9abe960b0b0c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:11.837004 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6d24ece-5f1d-443a-8072-9abe960b0b0c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:11.837444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6d24ece-5f1d-443a-8072-9abe960b0b0c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:11.883062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4d111c8e-d4bf-4294-bc92-bb2103263093 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:11.884145 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4d111c8e-d4bf-4294-bc92-bb2103263093 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:11.891103 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d111c8e-d4bf-4294-bc92-bb2103263093 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:11.891484 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d111c8e-d4bf-4294-bc92-bb2103263093 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:11.892540 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d111c8e-d4bf-4294-bc92-bb2103263093 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:11.893032 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d111c8e-d4bf-4294-bc92-bb2103263093 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:12.049543 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d6d24ece-5f1d-443a-8072-9abe960b0b0c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:12.053139 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4d111c8e-d4bf-4294-bc92-bb2103263093 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:12.058593 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d6d24ece-5f1d-443a-8072-9abe960b0b0c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1553 microversion: 2.1 time: 0.233785 Jun 04 18:30:12.058975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 91/197] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:11 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:12.069108 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4d111c8e-d4bf-4294-bc92-bb2103263093 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.190061 Jun 04 18:30:12.069767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 107/198] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:11 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:13.074726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a68de0bc-a219-4e34-bcde-82b73b2e9d1c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:13.075558 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a68de0bc-a219-4e34-bcde-82b73b2e9d1c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:13.087237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0f8e6446-bb3b-41e6-b704-d74d1bee2a49 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:13.087820 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0f8e6446-bb3b-41e6-b704-d74d1bee2a49 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:13.092872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a68de0bc-a219-4e34-bcde-82b73b2e9d1c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:13.093314 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a68de0bc-a219-4e34-bcde-82b73b2e9d1c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:13.094111 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a68de0bc-a219-4e34-bcde-82b73b2e9d1c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:13.094536 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a68de0bc-a219-4e34-bcde-82b73b2e9d1c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:13.102593 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f8e6446-bb3b-41e6-b704-d74d1bee2a49 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:13.103109 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f8e6446-bb3b-41e6-b704-d74d1bee2a49 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:13.103882 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f8e6446-bb3b-41e6-b704-d74d1bee2a49 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:13.104392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f8e6446-bb3b-41e6-b704-d74d1bee2a49 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:13.242030 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a68de0bc-a219-4e34-bcde-82b73b2e9d1c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:13.250433 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a68de0bc-a219-4e34-bcde-82b73b2e9d1c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1553 microversion: 2.1 time: 0.179585 Jun 04 18:30:13.260196 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 92/199] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:13 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:13.298514 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0f8e6446-bb3b-41e6-b704-d74d1bee2a49 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:13.307509 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0f8e6446-bb3b-41e6-b704-d74d1bee2a49 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.224884 Jun 04 18:30:13.308884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 108/200] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:13 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:14.270348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c6ef2acc-8e52-403b-81d4-3eb9d8c05df4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:14.271106 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c6ef2acc-8e52-403b-81d4-3eb9d8c05df4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:14.280079 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6ef2acc-8e52-403b-81d4-3eb9d8c05df4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:14.280908 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6ef2acc-8e52-403b-81d4-3eb9d8c05df4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:14.282237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6ef2acc-8e52-403b-81d4-3eb9d8c05df4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:14.282843 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6ef2acc-8e52-403b-81d4-3eb9d8c05df4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:14.325089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7eea2474-6d6e-40f4-95da-14eef90ee586 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:14.325645 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7eea2474-6d6e-40f4-95da-14eef90ee586 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:14.332343 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eea2474-6d6e-40f4-95da-14eef90ee586 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:14.332859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eea2474-6d6e-40f4-95da-14eef90ee586 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:14.333693 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eea2474-6d6e-40f4-95da-14eef90ee586 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:14.334172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eea2474-6d6e-40f4-95da-14eef90ee586 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:14.468400 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c6ef2acc-8e52-403b-81d4-3eb9d8c05df4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:14.474303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c6ef2acc-8e52-403b-81d4-3eb9d8c05df4 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1553 microversion: 2.1 time: 0.207764 Jun 04 18:30:14.475206 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 93/201] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:14 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:14.515221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7eea2474-6d6e-40f4-95da-14eef90ee586 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:14.522876 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7eea2474-6d6e-40f4-95da-14eef90ee586 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.202034 Jun 04 18:30:14.523693 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 109/202] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:14 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:15.495762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f3a97cf1-e350-4137-9c8c-3ba475c41213 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:15.496829 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f3a97cf1-e350-4137-9c8c-3ba475c41213 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:15.507885 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3a97cf1-e350-4137-9c8c-3ba475c41213 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:15.508402 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3a97cf1-e350-4137-9c8c-3ba475c41213 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:15.509179 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3a97cf1-e350-4137-9c8c-3ba475c41213 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:15.509583 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3a97cf1-e350-4137-9c8c-3ba475c41213 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:15.540869 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2175aa2f-c6f8-4e6c-bd67-7e5841ff2dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:15.541583 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2175aa2f-c6f8-4e6c-bd67-7e5841ff2dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:15.548274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2175aa2f-c6f8-4e6c-bd67-7e5841ff2dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:15.548804 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2175aa2f-c6f8-4e6c-bd67-7e5841ff2dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:15.549583 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2175aa2f-c6f8-4e6c-bd67-7e5841ff2dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:15.550022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2175aa2f-c6f8-4e6c-bd67-7e5841ff2dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:15.640297 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f3a97cf1-e350-4137-9c8c-3ba475c41213 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:15.648298 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f3a97cf1-e350-4137-9c8c-3ba475c41213 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1553 microversion: 2.1 time: 0.159198 Jun 04 18:30:15.649176 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 94/203] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:15 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:15.678585 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2175aa2f-c6f8-4e6c-bd67-7e5841ff2dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:15.686678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2175aa2f-c6f8-4e6c-bd67-7e5841ff2dd2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.150243 Jun 04 18:30:15.687282 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 110/204] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:15 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:16.668371 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-10ef7964-5f41-4e97-9532-a03edf89d215 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:16.668954 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-10ef7964-5f41-4e97-9532-a03edf89d215 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:16.675888 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10ef7964-5f41-4e97-9532-a03edf89d215 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:16.676374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10ef7964-5f41-4e97-9532-a03edf89d215 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:16.677129 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10ef7964-5f41-4e97-9532-a03edf89d215 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:16.677566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10ef7964-5f41-4e97-9532-a03edf89d215 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:16.704197 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-814e96c3-7c1e-4fa8-9866-2a4358a4da77 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:16.704835 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-814e96c3-7c1e-4fa8-9866-2a4358a4da77 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:16.711817 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-814e96c3-7c1e-4fa8-9866-2a4358a4da77 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:16.712208 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-814e96c3-7c1e-4fa8-9866-2a4358a4da77 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:16.712968 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-814e96c3-7c1e-4fa8-9866-2a4358a4da77 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:16.713444 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-814e96c3-7c1e-4fa8-9866-2a4358a4da77 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:16.817230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10ef7964-5f41-4e97-9532-a03edf89d215 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:16.825991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-10ef7964-5f41-4e97-9532-a03edf89d215 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1553 microversion: 2.1 time: 0.162673 Jun 04 18:30:16.826565 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 95/205] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:16 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:16.850974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-814e96c3-7c1e-4fa8-9866-2a4358a4da77 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:16.858809 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-814e96c3-7c1e-4fa8-9866-2a4358a4da77 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.158583 Jun 04 18:30:16.859373 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 111/206] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:16 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:17.843009 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e73c9f98-0397-4f19-81fb-824bccc4a726 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:17.843733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e73c9f98-0397-4f19-81fb-824bccc4a726 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:17.850423 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e73c9f98-0397-4f19-81fb-824bccc4a726 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:17.850878 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e73c9f98-0397-4f19-81fb-824bccc4a726 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:17.851647 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e73c9f98-0397-4f19-81fb-824bccc4a726 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:17.852112 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e73c9f98-0397-4f19-81fb-824bccc4a726 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:17.875972 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b550bcb3-44bb-403d-aa9d-cd7047a67c83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:17.876773 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b550bcb3-44bb-403d-aa9d-cd7047a67c83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:17.882993 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b550bcb3-44bb-403d-aa9d-cd7047a67c83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:17.883433 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b550bcb3-44bb-403d-aa9d-cd7047a67c83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:17.884313 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b550bcb3-44bb-403d-aa9d-cd7047a67c83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:17.884751 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b550bcb3-44bb-403d-aa9d-cd7047a67c83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:17.987444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e73c9f98-0397-4f19-81fb-824bccc4a726 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:17.995761 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e73c9f98-0397-4f19-81fb-824bccc4a726 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1553 microversion: 2.1 time: 0.156706 Jun 04 18:30:17.996376 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 96/207] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:17 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:18.013364 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b550bcb3-44bb-403d-aa9d-cd7047a67c83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:18.021134 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b550bcb3-44bb-403d-aa9d-cd7047a67c83 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.149081 Jun 04 18:30:18.021788 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 112/208] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:17 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:19.013884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-116f6163-a8a9-4ff9-9673-f659afffd60c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:19.015396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-116f6163-a8a9-4ff9-9673-f659afffd60c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:19.017901 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=42 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:19.021915 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-375d8e3e-fbce-42c5-bea6-39a593679be6 req-008aabaa-6f00-4ff1-b6f6-63934f6d1f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ab578f-9f7c-43f7-9a6c-ca54c0b9345c", "name": "network-vif-deleted", "tag": "2f300406-b453-4822-9635-d2e675926f86"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:30:19.024703 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-116f6163-a8a9-4ff9-9673-f659afffd60c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:19.026030 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-116f6163-a8a9-4ff9-9673-f659afffd60c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:19.026205 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-116f6163-a8a9-4ff9-9673-f659afffd60c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:19.026903 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-116f6163-a8a9-4ff9-9673-f659afffd60c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:19.033856 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-375d8e3e-fbce-42c5-bea6-39a593679be6 req-008aabaa-6f00-4ff1-b6f6-63934f6d1f7c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:19.034406 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-375d8e3e-fbce-42c5-bea6-39a593679be6 req-008aabaa-6f00-4ff1-b6f6-63934f6d1f7c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:19.051405 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-375d8e3e-fbce-42c5-bea6-39a593679be6 req-008aabaa-6f00-4ff1-b6f6-63934f6d1f7c service nova] Creating event network-vif-deleted:2f300406-b453-4822-9635-d2e675926f86 for instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c on hv-cinder-79053 Jun 04 18:30:19.058295 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-375d8e3e-fbce-42c5-bea6-39a593679be6 req-008aabaa-6f00-4ff1-b6f6-63934f6d1f7c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040553 Jun 04 18:30:19.059661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 113/209] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:30:19.067581 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4d34df4c-c57e-44e5-a04c-6bf87a1290f6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:19.069000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4d34df4c-c57e-44e5-a04c-6bf87a1290f6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:19.078063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d34df4c-c57e-44e5-a04c-6bf87a1290f6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:19.078513 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d34df4c-c57e-44e5-a04c-6bf87a1290f6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:19.080507 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d34df4c-c57e-44e5-a04c-6bf87a1290f6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:19.080975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d34df4c-c57e-44e5-a04c-6bf87a1290f6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:19.099369 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-116f6163-a8a9-4ff9-9673-f659afffd60c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:19.112748 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-116f6163-a8a9-4ff9-9673-f659afffd60c tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1511 microversion: 2.1 time: 0.103860 Jun 04 18:30:19.113722 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 97/210] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:19 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1511 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:19.228416 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4d34df4c-c57e-44e5-a04c-6bf87a1290f6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:19.236580 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4d34df4c-c57e-44e5-a04c-6bf87a1290f6 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.175286 Jun 04 18:30:19.237174 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 114/211] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:19 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:20.137728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8a4561a4-6939-4c05-8b2a-ebfa244ff49e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:20.138942 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8a4561a4-6939-4c05-8b2a-ebfa244ff49e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:20.149463 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8a4561a4-6939-4c05-8b2a-ebfa244ff49e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:20.150209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8a4561a4-6939-4c05-8b2a-ebfa244ff49e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:20.151335 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8a4561a4-6939-4c05-8b2a-ebfa244ff49e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:20.151767 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8a4561a4-6939-4c05-8b2a-ebfa244ff49e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:20.217157 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8a4561a4-6939-4c05-8b2a-ebfa244ff49e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:20.229666 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8a4561a4-6939-4c05-8b2a-ebfa244ff49e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1511 microversion: 2.1 time: 0.098476 Jun 04 18:30:20.230286 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 98/212] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:20 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:20.254528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-84331352-d9bd-4d4d-a0fd-5fb8bd80bf1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:20.255138 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-84331352-d9bd-4d4d-a0fd-5fb8bd80bf1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:20.261746 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84331352-d9bd-4d4d-a0fd-5fb8bd80bf1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:20.262206 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84331352-d9bd-4d4d-a0fd-5fb8bd80bf1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:20.262974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84331352-d9bd-4d4d-a0fd-5fb8bd80bf1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:20.263412 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84331352-d9bd-4d4d-a0fd-5fb8bd80bf1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:20.282454 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:20.399793 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84331352-d9bd-4d4d-a0fd-5fb8bd80bf1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:20.408450 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-84331352-d9bd-4d4d-a0fd-5fb8bd80bf1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.157835 Jun 04 18:30:20.409019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 115/213] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:20 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:21.251454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5c5c7109-ceb2-4fcf-b4b0-a5b49b5a7fec tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:21.252123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5c5c7109-ceb2-4fcf-b4b0-a5b49b5a7fec tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:21.258644 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c5c7109-ceb2-4fcf-b4b0-a5b49b5a7fec tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:21.259088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c5c7109-ceb2-4fcf-b4b0-a5b49b5a7fec tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:21.259843 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c5c7109-ceb2-4fcf-b4b0-a5b49b5a7fec tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:21.260483 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c5c7109-ceb2-4fcf-b4b0-a5b49b5a7fec tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:21.321814 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5c5c7109-ceb2-4fcf-b4b0-a5b49b5a7fec tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:21.330334 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5c5c7109-ceb2-4fcf-b4b0-a5b49b5a7fec tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1511 microversion: 2.1 time: 0.082881 Jun 04 18:30:21.330902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 99/214] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:21 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1511 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:21.433400 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1c0d8170-8fad-4ffc-90c5-0040efc6a90f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:21.434400 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1c0d8170-8fad-4ffc-90c5-0040efc6a90f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:21.437333 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:21.446217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c0d8170-8fad-4ffc-90c5-0040efc6a90f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:21.446861 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c0d8170-8fad-4ffc-90c5-0040efc6a90f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:21.448239 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c0d8170-8fad-4ffc-90c5-0040efc6a90f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:21.448663 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c0d8170-8fad-4ffc-90c5-0040efc6a90f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:21.591465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1c0d8170-8fad-4ffc-90c5-0040efc6a90f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:21.599598 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1c0d8170-8fad-4ffc-90c5-0040efc6a90f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.173551 Jun 04 18:30:21.600228 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 116/215] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:21 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:22.351832 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2ba00651-5a40-47ce-98d8-89f0e8c648b2 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:22.353034 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2ba00651-5a40-47ce-98d8-89f0e8c648b2 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:22.364339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ba00651-5a40-47ce-98d8-89f0e8c648b2 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:22.365108 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ba00651-5a40-47ce-98d8-89f0e8c648b2 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:22.366356 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ba00651-5a40-47ce-98d8-89f0e8c648b2 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:22.367078 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ba00651-5a40-47ce-98d8-89f0e8c648b2 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:22.431272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2ba00651-5a40-47ce-98d8-89f0e8c648b2 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:22.439721 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2ba00651-5a40-47ce-98d8-89f0e8c648b2 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1511 microversion: 2.1 time: 0.095479 Jun 04 18:30:22.440336 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 100/216] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:22 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:22.617162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e0477283-6a1a-45d7-acfe-2bc8c4181149 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:22.617801 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e0477283-6a1a-45d7-acfe-2bc8c4181149 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:22.624537 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0477283-6a1a-45d7-acfe-2bc8c4181149 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:22.624991 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0477283-6a1a-45d7-acfe-2bc8c4181149 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:22.625825 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0477283-6a1a-45d7-acfe-2bc8c4181149 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:22.626241 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0477283-6a1a-45d7-acfe-2bc8c4181149 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:22.763940 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0477283-6a1a-45d7-acfe-2bc8c4181149 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:22.771629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e0477283-6a1a-45d7-acfe-2bc8c4181149 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.158678 Jun 04 18:30:22.772232 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 117/217] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:22 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:23.458962 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7cda06ce-1da7-4ffb-8ff7-d4379fb3c7cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:23.459654 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7cda06ce-1da7-4ffb-8ff7-d4379fb3c7cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:23.470520 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7cda06ce-1da7-4ffb-8ff7-d4379fb3c7cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:23.471133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7cda06ce-1da7-4ffb-8ff7-d4379fb3c7cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:23.472349 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7cda06ce-1da7-4ffb-8ff7-d4379fb3c7cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:23.472992 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7cda06ce-1da7-4ffb-8ff7-d4379fb3c7cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:23.537941 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7cda06ce-1da7-4ffb-8ff7-d4379fb3c7cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:23.546725 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7cda06ce-1da7-4ffb-8ff7-d4379fb3c7cf tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1346 microversion: 2.1 time: 0.093910 Jun 04 18:30:23.547451 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 101/218] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:23 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:23.788726 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-20cbd532-8024-45dd-b719-f82a293def28 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:23.789672 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-20cbd532-8024-45dd-b719-f82a293def28 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:23.795863 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-20cbd532-8024-45dd-b719-f82a293def28 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:23.796341 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-20cbd532-8024-45dd-b719-f82a293def28 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:23.797113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-20cbd532-8024-45dd-b719-f82a293def28 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:23.797545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-20cbd532-8024-45dd-b719-f82a293def28 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:23.934342 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-20cbd532-8024-45dd-b719-f82a293def28 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:23.946959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-20cbd532-8024-45dd-b719-f82a293def28 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.161727 Jun 04 18:30:23.947868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 118/219] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:23 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:24.564917 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-916bd2ae-4ce6-4c32-95d4-8775a676f5ad tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:24.565519 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-916bd2ae-4ce6-4c32-95d4-8775a676f5ad tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:24.572284 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-916bd2ae-4ce6-4c32-95d4-8775a676f5ad tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:24.572986 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-916bd2ae-4ce6-4c32-95d4-8775a676f5ad tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:24.574365 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-916bd2ae-4ce6-4c32-95d4-8775a676f5ad tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:24.574803 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-916bd2ae-4ce6-4c32-95d4-8775a676f5ad tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:24.641923 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-916bd2ae-4ce6-4c32-95d4-8775a676f5ad tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:24.653174 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-916bd2ae-4ce6-4c32-95d4-8775a676f5ad tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1346 microversion: 2.1 time: 0.092286 Jun 04 18:30:24.653712 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 102/220] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:24 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:24.969220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7ff8fb54-05df-4fcc-bd54-121af09333b7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:24.969800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7ff8fb54-05df-4fcc-bd54-121af09333b7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:24.976259 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ff8fb54-05df-4fcc-bd54-121af09333b7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:24.976710 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ff8fb54-05df-4fcc-bd54-121af09333b7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:24.977469 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ff8fb54-05df-4fcc-bd54-121af09333b7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:24.977903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ff8fb54-05df-4fcc-bd54-121af09333b7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:25.110417 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7ff8fb54-05df-4fcc-bd54-121af09333b7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:25.118177 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7ff8fb54-05df-4fcc-bd54-121af09333b7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.152987 Jun 04 18:30:25.118755 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 119/221] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:24 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:25.670766 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f01d0996-5435-4477-8c86-aabc7fff2132 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:25.671290 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f01d0996-5435-4477-8c86-aabc7fff2132 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:25.677705 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f01d0996-5435-4477-8c86-aabc7fff2132 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:25.678156 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f01d0996-5435-4477-8c86-aabc7fff2132 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:25.678929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f01d0996-5435-4477-8c86-aabc7fff2132 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:25.679420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f01d0996-5435-4477-8c86-aabc7fff2132 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:25.743074 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f01d0996-5435-4477-8c86-aabc7fff2132 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:25.751244 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f01d0996-5435-4477-8c86-aabc7fff2132 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1346 microversion: 2.1 time: 0.084541 Jun 04 18:30:25.751816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 103/222] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:25 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:26.135051 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-979bc7de-a2cc-40e8-be18-d404221e5848 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:26.135561 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-979bc7de-a2cc-40e8-be18-d404221e5848 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:26.141819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-979bc7de-a2cc-40e8-be18-d404221e5848 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:26.142269 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-979bc7de-a2cc-40e8-be18-d404221e5848 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:26.143032 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-979bc7de-a2cc-40e8-be18-d404221e5848 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:26.143463 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-979bc7de-a2cc-40e8-be18-d404221e5848 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:26.285676 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-979bc7de-a2cc-40e8-be18-d404221e5848 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:26.294460 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-979bc7de-a2cc-40e8-be18-d404221e5848 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.163739 Jun 04 18:30:26.313546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 120/223] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:26 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:26.768225 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:26.768855 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:26.775665 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:26.776206 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:26.777666 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:26.778331 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:26.810309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:26.810756 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:26.811215 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lazy-loading 'fault' on Instance uuid 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:30:26.856122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:26.864581 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-76f4ccf9-ccfe-4248-a51e-ae0295d5530a tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1351 microversion: 2.1 time: 0.100304 Jun 04 18:30:26.865121 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 104/224] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:26 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:27.312996 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-36275ad9-867d-4186-b659-7554fea19d1b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:27.314236 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-36275ad9-867d-4186-b659-7554fea19d1b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:27.320793 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36275ad9-867d-4186-b659-7554fea19d1b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:27.321256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36275ad9-867d-4186-b659-7554fea19d1b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:27.322023 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36275ad9-867d-4186-b659-7554fea19d1b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:27.322454 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36275ad9-867d-4186-b659-7554fea19d1b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:27.509782 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-36275ad9-867d-4186-b659-7554fea19d1b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:27.521002 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-36275ad9-867d-4186-b659-7554fea19d1b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.211474 Jun 04 18:30:27.521836 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 121/225] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:27 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:27.882294 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:27.883514 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:27.890407 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:27.890887 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:27.891651 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:27.892116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:27.897682 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:27.923424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:27.923872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:27.924366 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lazy-loading 'fault' on Instance uuid 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:30:27.967109 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:27.975346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-19c589d6-1b06-4f64-a1eb-fb1756c12a4b tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1351 microversion: 2.1 time: 0.097219 Jun 04 18:30:27.977095 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 105/226] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:27 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:28.538710 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-51d5fbeb-4d39-435d-9b5a-3723ba2dcf01 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:28.539676 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-51d5fbeb-4d39-435d-9b5a-3723ba2dcf01 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:28.545804 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51d5fbeb-4d39-435d-9b5a-3723ba2dcf01 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:28.546252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51d5fbeb-4d39-435d-9b5a-3723ba2dcf01 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:28.547033 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51d5fbeb-4d39-435d-9b5a-3723ba2dcf01 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:28.547472 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51d5fbeb-4d39-435d-9b5a-3723ba2dcf01 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:28.687222 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-51d5fbeb-4d39-435d-9b5a-3723ba2dcf01 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:28.695854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-51d5fbeb-4d39-435d-9b5a-3723ba2dcf01 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.160970 Jun 04 18:30:28.696580 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 122/227] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:28 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:28.992478 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:28.993166 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:29.000822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:29.001356 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:29.002112 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:29.002525 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:29.036805 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:29.037226 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:29.037670 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lazy-loading 'fault' on Instance uuid 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:30:29.084741 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:29.096204 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a255cbac-34b0-4858-838f-87acc12544de tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1351 microversion: 2.1 time: 0.107268 Jun 04 18:30:29.097158 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 106/228] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:28 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:29.713016 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6de10206-deed-4b25-8295-c78ee03e7881 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:29.714231 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6de10206-deed-4b25-8295-c78ee03e7881 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:29.721347 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6de10206-deed-4b25-8295-c78ee03e7881 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:29.721795 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6de10206-deed-4b25-8295-c78ee03e7881 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:29.722684 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6de10206-deed-4b25-8295-c78ee03e7881 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:29.723401 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6de10206-deed-4b25-8295-c78ee03e7881 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:29.864215 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6de10206-deed-4b25-8295-c78ee03e7881 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:29.875385 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6de10206-deed-4b25-8295-c78ee03e7881 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.166408 Jun 04 18:30:29.876382 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 123/229] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:29 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:30.115501 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:30.116288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:30.123602 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:30.124080 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:30.124853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:30.125341 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:30.162303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:30.162733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:30.163189 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lazy-loading 'fault' on Instance uuid 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:30:30.213526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0b3c1b83e3f46a5a2d2593191f118ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8e7a5f85464feeb943b5da573f0844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:30.222277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bbb266d4-3aee-44bd-b2d5-4324402c23d3 tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 200 len: 1351 microversion: 2.1 time: 0.110916 Jun 04 18:30:30.223050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 107/230] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:30 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:30.892744 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-85b7d0a9-6bf4-482b-bb09-433fe81531fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:30.893291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-85b7d0a9-6bf4-482b-bb09-433fe81531fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:30.899723 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85b7d0a9-6bf4-482b-bb09-433fe81531fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:30.900212 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85b7d0a9-6bf4-482b-bb09-433fe81531fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:30.900969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85b7d0a9-6bf4-482b-bb09-433fe81531fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:30.901456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85b7d0a9-6bf4-482b-bb09-433fe81531fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:31.034329 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-85b7d0a9-6bf4-482b-bb09-433fe81531fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:31.046286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-85b7d0a9-6bf4-482b-bb09-433fe81531fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.157582 Jun 04 18:30:31.046857 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 124/231] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:30 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:31.238855 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:31.239455 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:31.247264 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:31.248212 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:31.248755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:31.249409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:31.263989 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] HTTP exception thrown: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Request method failure captured: Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c HTTP/1.1 Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6RhD3OK_DELHUZMm_4q04WpEdgpALSaoyzGhUCtY9xznxa5cO66Kb5w2Qp9UiMRKZPmSjATCabInWMdugXC7QVrhPTeAB-fKq6HsvU551Py1-f7luaCktBhP1g-muR9WxboqWpExXdFcmU3IoeaOAJECpRt715K1D_e9FOid2sMroA Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 1d8e7a5f85464feeb943b5da573f0844 Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:30:31.268866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d8e7a5f85464feeb943b5da573f0844"}]}] Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 1d8e7a5f85464feeb943b5da573f0844 Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-DeleteServersTestJSON-1629462551-project Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: e0b3c1b83e3f46a5a2d2593191f118ec Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-DeleteServersTestJSON-1629462551-project Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.270364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '92ab578f-9f7c-43f7-9a6c-ca54c0b9345c'} Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:30:31.271102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.272278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.273281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Returning 404 to user: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:30:31.273281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bc6620fe-d9f9-4659-b7c6-cf6929998c9d tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 404 len: 111 microversion: 2.1 time: 0.035383 Jun 04 18:30:31.273281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 108/232] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:31 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:30:31.381628 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:31.382631 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:31.389328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:31.389819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:31.390589 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:31.391012 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:31.404617 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] HTTP exception thrown: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Request method failure captured: Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c/os-volume_attachments HTTP/1.1 Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6RhD3OK_DELHUZMm_4q04WpEdgpALSaoyzGhUCtY9xznxa5cO66Kb5w2Qp9UiMRKZPmSjATCabInWMdugXC7QVrhPTeAB-fKq6HsvU551Py1-f7luaCktBhP1g-muR9WxboqWpExXdFcmU3IoeaOAJECpRt715K1D_e9FOid2sMroA Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 1d8e7a5f85464feeb943b5da573f0844 Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:30:31.408661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d8e7a5f85464feeb943b5da573f0844"}]}] Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 1d8e7a5f85464feeb943b5da573f0844 Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-DeleteServersTestJSON-1629462551-project Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: e0b3c1b83e3f46a5a2d2593191f118ec Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-DeleteServersTestJSON-1629462551-project Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.410037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'server_id': '92ab578f-9f7c-43f7-9a6c-ca54c0b9345c'} Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:30:31.410812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:31.412083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:31.413373 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Returning 404 to user: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:30:31.413373 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-952a8ac5-1788-4568-a548-58e89986239e tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032501 Jun 04 18:30:31.413373 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 125/233] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:30:31 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:30:32.063469 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-83dd13e0-0f72-4535-8075-4b0321b08dba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:32.064107 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-83dd13e0-0f72-4535-8075-4b0321b08dba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:32.070726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-83dd13e0-0f72-4535-8075-4b0321b08dba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:32.071179 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-83dd13e0-0f72-4535-8075-4b0321b08dba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:32.071974 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-83dd13e0-0f72-4535-8075-4b0321b08dba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:32.072428 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-83dd13e0-0f72-4535-8075-4b0321b08dba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:32.216542 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-83dd13e0-0f72-4535-8075-4b0321b08dba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:32.224285 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-83dd13e0-0f72-4535-8075-4b0321b08dba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.165003 Jun 04 18:30:32.224820 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 109/234] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:32 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:33.242489 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b79aac69-0b1a-465f-aad2-fc8e295528ca tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:33.243111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b79aac69-0b1a-465f-aad2-fc8e295528ca tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:33.249575 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b79aac69-0b1a-465f-aad2-fc8e295528ca tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:33.250037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b79aac69-0b1a-465f-aad2-fc8e295528ca tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:33.250847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b79aac69-0b1a-465f-aad2-fc8e295528ca tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:33.251283 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b79aac69-0b1a-465f-aad2-fc8e295528ca tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:33.405263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b79aac69-0b1a-465f-aad2-fc8e295528ca tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:33.415468 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b79aac69-0b1a-465f-aad2-fc8e295528ca tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.176672 Jun 04 18:30:33.416036 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 126/235] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:33 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:33.674457 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:33.674982 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:33.683854 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:33.684344 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:33.685153 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:33.685636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:33.699442 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] HTTP exception thrown: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Request method failure captured: Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c HTTP/1.1 Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6RhD3OK_DELHUZMm_4q04WpEdgpALSaoyzGhUCtY9xznxa5cO66Kb5w2Qp9UiMRKZPmSjATCabInWMdugXC7QVrhPTeAB-fKq6HsvU551Py1-f7luaCktBhP1g-muR9WxboqWpExXdFcmU3IoeaOAJECpRt715K1D_e9FOid2sMroA Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 1d8e7a5f85464feeb943b5da573f0844 Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:30:33.701012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d8e7a5f85464feeb943b5da573f0844"}]}] Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 1d8e7a5f85464feeb943b5da573f0844 Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-DeleteServersTestJSON-1629462551-project Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: e0b3c1b83e3f46a5a2d2593191f118ec Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-DeleteServersTestJSON-1629462551-project Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.702229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '92ab578f-9f7c-43f7-9a6c-ca54c0b9345c'} Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:30:33.702884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.703981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.705485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Returning 404 to user: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:30:33.705485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f1e72097-9769-4bf1-a675-11d6c53b89be tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "DELETE /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 404 len: 111 microversion: 2.1 time: 0.033143 Jun 04 18:30:33.705485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 110/236] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:30:33 2022] DELETE /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:30:33.711716 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:33.712435 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] [instance: 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:33.719490 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:33.719947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:33.720746 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:33.721182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:33.735042 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] HTTP exception thrown: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Request method failure captured: Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c HTTP/1.1 Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6RhD3OK_DELHUZMm_4q04WpEdgpALSaoyzGhUCtY9xznxa5cO66Kb5w2Qp9UiMRKZPmSjATCabInWMdugXC7QVrhPTeAB-fKq6HsvU551Py1-f7luaCktBhP1g-muR9WxboqWpExXdFcmU3IoeaOAJECpRt715K1D_e9FOid2sMroA Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 1d8e7a5f85464feeb943b5da573f0844 Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:30:33.738098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d8e7a5f85464feeb943b5da573f0844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d8e7a5f85464feeb943b5da573f0844"}]}] Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 1d8e7a5f85464feeb943b5da573f0844 Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-DeleteServersTestJSON-1629462551 Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-DeleteServersTestJSON-1629462551-project Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: e0b3c1b83e3f46a5a2d2593191f118ec Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-DeleteServersTestJSON-1629462551-project Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.739299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '92ab578f-9f7c-43f7-9a6c-ca54c0b9345c'} Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:30:33.739975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. Jun 04 18:30:33.741161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:30:33.742458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] Returning 404 to user: Instance 92ab578f-9f7c-43f7-9a6c-ca54c0b9345c could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:30:33.742458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1ce4bd2b-7f1d-4c1c-97fa-120e16e2691f tempest-DeleteServersTestJSON-1629462551 tempest-DeleteServersTestJSON-1629462551-project] 10.222.0.39 "GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c" status: 404 len: 111 microversion: 2.1 time: 0.032514 Jun 04 18:30:33.742458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 127/237] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:33 2022] GET /compute/v2.1/servers/92ab578f-9f7c-43f7-9a6c-ca54c0b9345c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:30:34.432691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a12760ec-3ddb-431c-8b75-ef659a3bf3c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:34.433309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a12760ec-3ddb-431c-8b75-ef659a3bf3c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:34.440512 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a12760ec-3ddb-431c-8b75-ef659a3bf3c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:34.440977 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a12760ec-3ddb-431c-8b75-ef659a3bf3c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:34.441874 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a12760ec-3ddb-431c-8b75-ef659a3bf3c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:34.442763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a12760ec-3ddb-431c-8b75-ef659a3bf3c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:34.657255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a12760ec-3ddb-431c-8b75-ef659a3bf3c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:34.666423 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a12760ec-3ddb-431c-8b75-ef659a3bf3c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.237776 Jun 04 18:30:34.667101 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 111/238] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:34 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:35.684328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-32798bb0-ae0d-4752-b1c8-f9f93b0aaf67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:35.685467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-32798bb0-ae0d-4752-b1c8-f9f93b0aaf67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:35.692903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-32798bb0-ae0d-4752-b1c8-f9f93b0aaf67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:35.693585 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-32798bb0-ae0d-4752-b1c8-f9f93b0aaf67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:35.694513 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-32798bb0-ae0d-4752-b1c8-f9f93b0aaf67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:35.695164 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-32798bb0-ae0d-4752-b1c8-f9f93b0aaf67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:35.925581 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-32798bb0-ae0d-4752-b1c8-f9f93b0aaf67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:35.934478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-32798bb0-ae0d-4752-b1c8-f9f93b0aaf67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.254007 Jun 04 18:30:35.943970 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 128/239] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:35 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:36.956974 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1577fc9c-cd1a-4220-bc96-14a4531b123b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:36.958169 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1577fc9c-cd1a-4220-bc96-14a4531b123b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:36.971148 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1577fc9c-cd1a-4220-bc96-14a4531b123b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:36.971853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1577fc9c-cd1a-4220-bc96-14a4531b123b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:36.972928 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1577fc9c-cd1a-4220-bc96-14a4531b123b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:36.973515 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1577fc9c-cd1a-4220-bc96-14a4531b123b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:37.150458 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1577fc9c-cd1a-4220-bc96-14a4531b123b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:37.160293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1577fc9c-cd1a-4220-bc96-14a4531b123b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.212615 Jun 04 18:30:37.160868 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 112/240] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:36 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:38.181766 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-aaf4e0fa-61ae-442d-b341-ef24b7ce5b76 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:38.181766 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-aaf4e0fa-61ae-442d-b341-ef24b7ce5b76 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:38.189321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aaf4e0fa-61ae-442d-b341-ef24b7ce5b76 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:38.189800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aaf4e0fa-61ae-442d-b341-ef24b7ce5b76 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:38.190610 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aaf4e0fa-61ae-442d-b341-ef24b7ce5b76 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:38.191042 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aaf4e0fa-61ae-442d-b341-ef24b7ce5b76 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:38.460763 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-aaf4e0fa-61ae-442d-b341-ef24b7ce5b76 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:38.469489 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-aaf4e0fa-61ae-442d-b341-ef24b7ce5b76 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.293984 Jun 04 18:30:38.474391 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 129/241] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:38 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:39.490912 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4a321c63-38c1-45fc-8272-de963c5d3a6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:39.491515 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4a321c63-38c1-45fc-8272-de963c5d3a6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:39.498614 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4a321c63-38c1-45fc-8272-de963c5d3a6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:39.499399 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4a321c63-38c1-45fc-8272-de963c5d3a6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:39.500347 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4a321c63-38c1-45fc-8272-de963c5d3a6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:39.500924 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4a321c63-38c1-45fc-8272-de963c5d3a6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:39.701409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4a321c63-38c1-45fc-8272-de963c5d3a6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:39.713805 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4a321c63-38c1-45fc-8272-de963c5d3a6a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.226739 Jun 04 18:30:39.715629 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 113/242] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:39 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:40.732790 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2286ab09-6fe9-4263-a081-868e655773df tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:40.733548 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2286ab09-6fe9-4263-a081-868e655773df tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:40.743727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2286ab09-6fe9-4263-a081-868e655773df tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:40.744511 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2286ab09-6fe9-4263-a081-868e655773df tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:40.745369 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2286ab09-6fe9-4263-a081-868e655773df tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:40.746761 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2286ab09-6fe9-4263-a081-868e655773df tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:40.925122 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2286ab09-6fe9-4263-a081-868e655773df tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:40.936370 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2286ab09-6fe9-4263-a081-868e655773df tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.208767 Jun 04 18:30:40.937788 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 130/243] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:40 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:41.179711 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-223a4340-d4c8-4a3b-9b34-3c3a84e17ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: .version_select at 0x7f467e199a60>, body: {"keypair": {"name": "tempest-keypair-1762085348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGypTtzyrmHyk2bfwDCvksWko5YT+CQYiyBh2otBwZj1Vx/DMMOD5d4qwjkLSK6IN6/EeIa8xChCoFwlCi7VWPpZdvAL41QnDBMCchfzuV3bdy6DzmA/vaTS6/tgqkSHqw=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:30:41.203833 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-223a4340-d4c8-4a3b-9b34-3c3a84e17ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:30:41.210703 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-223a4340-d4c8-4a3b-9b34-3c3a84e17ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for user 5b5a9f5cdfa6494d97617d68880d5552 and project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:30:41.291105 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-223a4340-d4c8-4a3b-9b34-3c3a84e17ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.500546 Jun 04 18:30:41.296048 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 114/244] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:30:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:30:41.953341 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f2e2381e-e8bc-4d44-82d1-cbee0f5a51ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:41.954616 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f2e2381e-e8bc-4d44-82d1-cbee0f5a51ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:41.961535 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f2e2381e-e8bc-4d44-82d1-cbee0f5a51ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:41.962468 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f2e2381e-e8bc-4d44-82d1-cbee0f5a51ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:41.964192 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f2e2381e-e8bc-4d44-82d1-cbee0f5a51ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:41.965054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f2e2381e-e8bc-4d44-82d1-cbee0f5a51ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:42.283299 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f2e2381e-e8bc-4d44-82d1-cbee0f5a51ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:42.292641 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f2e2381e-e8bc-4d44-82d1-cbee0f5a51ae tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.343085 Jun 04 18:30:42.300506 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 131/245] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:41 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:43.295522 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1021144974", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2590cab-faa4-4157-aaba-3c7a446c9e61"}], "security_groups": [{"name": "tempest-securitygroup--993662849"}], "key_name": "tempest-keypair-1762085348", "user_data": "}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:30:43.317498 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ff03f780-071e-4d6a-916e-8e01db278736 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:43.318333 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ff03f780-071e-4d6a-916e-8e01db278736 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:43.325388 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ff03f780-071e-4d6a-916e-8e01db278736 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:43.326151 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ff03f780-071e-4d6a-916e-8e01db278736 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:43.327132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ff03f780-071e-4d6a-916e-8e01db278736 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:43.327755 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ff03f780-071e-4d6a-916e-8e01db278736 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:43.474983 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] validate_networks() for [('e2590cab-faa4-4157-aaba-3c7a446c9e61', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:30:43.513111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ff03f780-071e-4d6a-916e-8e01db278736 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:43.525033 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ff03f780-071e-4d6a-916e-8e01db278736 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.211480 Jun 04 18:30:43.534617 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 132/246] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:43 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:44.086242 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:30:44.086808 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:30:44.087279 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:30:44.087766 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:30:44.088324 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:30:44.114394 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:44.117073 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:44.119727 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:44.121349 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:44.179929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:30:44.185820 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for user 5b5a9f5cdfa6494d97617d68880d5552 and project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:30:44.215941 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:30:44.218256 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:30:44.327833 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6ae13f81-40f6-42da-b2d9-423516eee6b2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.041022 Jun 04 18:30:44.329242 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 115/247] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:30:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:30:44.339097 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-616ea335-e221-4b4a-8300-4086e3a878fc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:44.339806 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-616ea335-e221-4b4a-8300-4086e3a878fc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:44.409627 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-616ea335-e221-4b4a-8300-4086e3a878fc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:44.417799 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-616ea335-e221-4b4a-8300-4086e3a878fc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1242 microversion: 2.1 time: 0.082251 Jun 04 18:30:44.418666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 133/248] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:44 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:44.544223 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5668c4dd-7faa-43eb-8c39-7e966c06b1de tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:44.544851 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5668c4dd-7faa-43eb-8c39-7e966c06b1de tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:44.552077 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5668c4dd-7faa-43eb-8c39-7e966c06b1de tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:44.552489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5668c4dd-7faa-43eb-8c39-7e966c06b1de tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:44.553323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5668c4dd-7faa-43eb-8c39-7e966c06b1de tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:44.554251 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5668c4dd-7faa-43eb-8c39-7e966c06b1de tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:44.783790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5668c4dd-7faa-43eb-8c39-7e966c06b1de tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:44.796767 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5668c4dd-7faa-43eb-8c39-7e966c06b1de tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.258396 Jun 04 18:30:44.797969 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 116/249] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:44 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:45.439320 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bc70bf76-d8ad-4159-877e-e12591720a7c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:45.439955 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bc70bf76-d8ad-4159-877e-e12591720a7c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:45.478752 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc70bf76-d8ad-4159-877e-e12591720a7c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:45.485027 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc70bf76-d8ad-4159-877e-e12591720a7c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:45.486518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc70bf76-d8ad-4159-877e-e12591720a7c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:45.488098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc70bf76-d8ad-4159-877e-e12591720a7c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:45.521194 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:45.595780 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bc70bf76-d8ad-4159-877e-e12591720a7c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:45.607192 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bc70bf76-d8ad-4159-877e-e12591720a7c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1238 microversion: 2.1 time: 0.175991 Jun 04 18:30:45.607781 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 134/250] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:45 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1238 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:45.818678 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-136c403a-8929-433c-8e99-cd02455961dc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:45.821569 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-136c403a-8929-433c-8e99-cd02455961dc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:45.838588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-136c403a-8929-433c-8e99-cd02455961dc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:45.841613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-136c403a-8929-433c-8e99-cd02455961dc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:45.842602 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-136c403a-8929-433c-8e99-cd02455961dc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:45.844100 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-136c403a-8929-433c-8e99-cd02455961dc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:46.093620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-136c403a-8929-433c-8e99-cd02455961dc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:46.104329 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-136c403a-8929-433c-8e99-cd02455961dc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.293538 Jun 04 18:30:46.114887 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 117/251] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:45 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:46.627967 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-84c17eab-4e7a-468a-86bd-12e779522e28 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:46.630229 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-84c17eab-4e7a-468a-86bd-12e779522e28 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:46.641316 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c17eab-4e7a-468a-86bd-12e779522e28 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:46.646085 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c17eab-4e7a-468a-86bd-12e779522e28 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:46.647141 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c17eab-4e7a-468a-86bd-12e779522e28 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:46.648849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c17eab-4e7a-468a-86bd-12e779522e28 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:46.736976 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84c17eab-4e7a-468a-86bd-12e779522e28 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:46.747009 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-84c17eab-4e7a-468a-86bd-12e779522e28 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1294 microversion: 2.1 time: 0.126206 Jun 04 18:30:46.747593 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 135/252] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:46 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:47.122108 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-01268ce1-f8d6-4d86-9d33-7d52cf0a5f87 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:47.124788 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-01268ce1-f8d6-4d86-9d33-7d52cf0a5f87 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:47.132314 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-01268ce1-f8d6-4d86-9d33-7d52cf0a5f87 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:47.132996 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-01268ce1-f8d6-4d86-9d33-7d52cf0a5f87 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:47.134177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-01268ce1-f8d6-4d86-9d33-7d52cf0a5f87 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:47.134783 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-01268ce1-f8d6-4d86-9d33-7d52cf0a5f87 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:47.298290 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-01268ce1-f8d6-4d86-9d33-7d52cf0a5f87 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:47.313026 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-01268ce1-f8d6-4d86-9d33-7d52cf0a5f87 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.195282 Jun 04 18:30:47.313618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 118/253] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:47 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:47.764219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1fd7dec8-e88f-4616-a1c5-286622f4b23e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:47.765725 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1fd7dec8-e88f-4616-a1c5-286622f4b23e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:47.773401 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1fd7dec8-e88f-4616-a1c5-286622f4b23e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:47.773990 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1fd7dec8-e88f-4616-a1c5-286622f4b23e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:47.774977 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1fd7dec8-e88f-4616-a1c5-286622f4b23e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:47.775658 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1fd7dec8-e88f-4616-a1c5-286622f4b23e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:47.847545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1fd7dec8-e88f-4616-a1c5-286622f4b23e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:47.855591 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1fd7dec8-e88f-4616-a1c5-286622f4b23e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1294 microversion: 2.1 time: 0.095461 Jun 04 18:30:47.856315 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 136/254] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:47 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:48.330069 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e94c15f1-0780-47da-81cc-1d3d19aa4f2a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:48.330673 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e94c15f1-0780-47da-81cc-1d3d19aa4f2a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:48.337812 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e94c15f1-0780-47da-81cc-1d3d19aa4f2a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:48.338256 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e94c15f1-0780-47da-81cc-1d3d19aa4f2a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:48.339043 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e94c15f1-0780-47da-81cc-1d3d19aa4f2a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:48.339520 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e94c15f1-0780-47da-81cc-1d3d19aa4f2a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:48.520326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e94c15f1-0780-47da-81cc-1d3d19aa4f2a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:48.529627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e94c15f1-0780-47da-81cc-1d3d19aa4f2a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.203265 Jun 04 18:30:48.530198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 119/255] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:48 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:48.874433 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-941cd936-028c-4ff1-80de-02fac72c2202 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:48.875064 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-941cd936-028c-4ff1-80de-02fac72c2202 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:48.882700 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-941cd936-028c-4ff1-80de-02fac72c2202 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:48.883158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-941cd936-028c-4ff1-80de-02fac72c2202 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:48.884320 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-941cd936-028c-4ff1-80de-02fac72c2202 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:48.884917 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-941cd936-028c-4ff1-80de-02fac72c2202 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:48.957881 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-941cd936-028c-4ff1-80de-02fac72c2202 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:48.980528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-941cd936-028c-4ff1-80de-02fac72c2202 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1294 microversion: 2.1 time: 0.110511 Jun 04 18:30:48.981120 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 137/256] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:48 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:49.548043 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2d094c8d-9585-4311-9ef4-1cf35a88755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:49.549231 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2d094c8d-9585-4311-9ef4-1cf35a88755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:49.551747 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:49.563311 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2d094c8d-9585-4311-9ef4-1cf35a88755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:49.563311 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2d094c8d-9585-4311-9ef4-1cf35a88755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:49.563654 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2d094c8d-9585-4311-9ef4-1cf35a88755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:49.565427 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2d094c8d-9585-4311-9ef4-1cf35a88755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:49.754261 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2d094c8d-9585-4311-9ef4-1cf35a88755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:49.765448 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2d094c8d-9585-4311-9ef4-1cf35a88755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.222387 Jun 04 18:30:49.766396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 120/257] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:49 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:50.013012 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-083ef9aa-f3fa-4f57-864e-0c99fdfdab4b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:50.014301 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-083ef9aa-f3fa-4f57-864e-0c99fdfdab4b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:50.023972 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-083ef9aa-f3fa-4f57-864e-0c99fdfdab4b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:50.029007 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-083ef9aa-f3fa-4f57-864e-0c99fdfdab4b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:50.031624 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-083ef9aa-f3fa-4f57-864e-0c99fdfdab4b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:50.032259 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-083ef9aa-f3fa-4f57-864e-0c99fdfdab4b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:50.248689 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-083ef9aa-f3fa-4f57-864e-0c99fdfdab4b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:50.267438 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-083ef9aa-f3fa-4f57-864e-0c99fdfdab4b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.264318 Jun 04 18:30:50.269174 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 138/258] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:49 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:50.783409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6084f1ad-b153-4012-9684-158ed983fab2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:50.784109 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6084f1ad-b153-4012-9684-158ed983fab2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:50.794396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6084f1ad-b153-4012-9684-158ed983fab2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:50.795071 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6084f1ad-b153-4012-9684-158ed983fab2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:50.813788 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6084f1ad-b153-4012-9684-158ed983fab2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:50.814456 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6084f1ad-b153-4012-9684-158ed983fab2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:51.095347 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6084f1ad-b153-4012-9684-158ed983fab2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:51.108410 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6084f1ad-b153-4012-9684-158ed983fab2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.329016 Jun 04 18:30:51.111425 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 121/259] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:50 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:51.287767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-58dc5ecb-efaf-4e2f-80d5-97f9115d1302 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:51.288584 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-58dc5ecb-efaf-4e2f-80d5-97f9115d1302 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:51.301173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58dc5ecb-efaf-4e2f-80d5-97f9115d1302 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:51.306793 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58dc5ecb-efaf-4e2f-80d5-97f9115d1302 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:51.310573 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58dc5ecb-efaf-4e2f-80d5-97f9115d1302 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:51.312624 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58dc5ecb-efaf-4e2f-80d5-97f9115d1302 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:51.947362 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-58dc5ecb-efaf-4e2f-80d5-97f9115d1302 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:51.956863 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-58dc5ecb-efaf-4e2f-80d5-97f9115d1302 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.673415 Jun 04 18:30:51.957449 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 139/260] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:51 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:52.129969 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-992ce197-0ed2-460e-91c7-76124930da69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:52.130848 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-992ce197-0ed2-460e-91c7-76124930da69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:52.143733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-992ce197-0ed2-460e-91c7-76124930da69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:52.153503 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-992ce197-0ed2-460e-91c7-76124930da69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:52.154776 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-992ce197-0ed2-460e-91c7-76124930da69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:52.156697 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-992ce197-0ed2-460e-91c7-76124930da69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:52.281073 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-1a56224c-0a5f-4b97-a820-d04e2e1bec2d req-0c90b6f2-769f-4d7d-b323-0460d80614fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31", "tag": "2b7956c3-20c4-469e-ae08-40dda4b0084a"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:30:52.285050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=50 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:52.298084 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1a56224c-0a5f-4b97-a820-d04e2e1bec2d req-0c90b6f2-769f-4d7d-b323-0460d80614fc service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:52.301182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1a56224c-0a5f-4b97-a820-d04e2e1bec2d req-0c90b6f2-769f-4d7d-b323-0460d80614fc service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:52.337451 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-1a56224c-0a5f-4b97-a820-d04e2e1bec2d req-0c90b6f2-769f-4d7d-b323-0460d80614fc service nova] Creating event network-changed:2b7956c3-20c4-469e-ae08-40dda4b0084a for instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 on hv-cinder-79053 Jun 04 18:30:52.345073 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-1a56224c-0a5f-4b97-a820-d04e2e1bec2d req-0c90b6f2-769f-4d7d-b323-0460d80614fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068888 Jun 04 18:30:52.345983 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 140/261] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:30:52.426942 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-992ce197-0ed2-460e-91c7-76124930da69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:52.468151 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-992ce197-0ed2-460e-91c7-76124930da69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1523 microversion: 2.1 time: 0.338929 Jun 04 18:30:52.474607 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 122/262] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:52 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:52.974954 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cc37bc96-c918-41da-a1fb-e6def8669d5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:52.977456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cc37bc96-c918-41da-a1fb-e6def8669d5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:53.000811 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc37bc96-c918-41da-a1fb-e6def8669d5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:53.002137 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc37bc96-c918-41da-a1fb-e6def8669d5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:53.004384 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc37bc96-c918-41da-a1fb-e6def8669d5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:53.005734 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc37bc96-c918-41da-a1fb-e6def8669d5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:53.465604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cc37bc96-c918-41da-a1fb-e6def8669d5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:53.497328 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5638af16-82d0-4da7-bb5e-8a3ab36dc6a7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:53.497945 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5638af16-82d0-4da7-bb5e-8a3ab36dc6a7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:53.511723 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cc37bc96-c918-41da-a1fb-e6def8669d5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.541229 Jun 04 18:30:53.514562 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 141/263] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:52 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:53.516516 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5638af16-82d0-4da7-bb5e-8a3ab36dc6a7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:53.517149 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5638af16-82d0-4da7-bb5e-8a3ab36dc6a7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:53.519496 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5638af16-82d0-4da7-bb5e-8a3ab36dc6a7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:53.521452 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5638af16-82d0-4da7-bb5e-8a3ab36dc6a7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:53.830211 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5638af16-82d0-4da7-bb5e-8a3ab36dc6a7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:53.832548 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:53.843585 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5638af16-82d0-4da7-bb5e-8a3ab36dc6a7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1503 microversion: 2.1 time: 0.356845 Jun 04 18:30:53.844420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 123/264] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:53 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:53.866186 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8d4a09e9-d9a9-4a31-b1ba-d13abf51a3ab tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:53.867161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8d4a09e9-d9a9-4a31-b1ba-d13abf51a3ab tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:53.878155 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8d4a09e9-d9a9-4a31-b1ba-d13abf51a3ab tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:53.879070 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8d4a09e9-d9a9-4a31-b1ba-d13abf51a3ab tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:53.882092 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8d4a09e9-d9a9-4a31-b1ba-d13abf51a3ab tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:53.882720 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8d4a09e9-d9a9-4a31-b1ba-d13abf51a3ab tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:54.137989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8d4a09e9-d9a9-4a31-b1ba-d13abf51a3ab tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:54.148064 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8d4a09e9-d9a9-4a31-b1ba-d13abf51a3ab tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1516 microversion: 2.1 time: 0.289001 Jun 04 18:30:54.149382 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 142/265] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:53 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:54.531632 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d8a18ee6-cfce-4e50-b75d-067c745071e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:54.533074 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d8a18ee6-cfce-4e50-b75d-067c745071e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:54.541123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:54.544337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=10 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:54.550299 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8a18ee6-cfce-4e50-b75d-067c745071e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:54.550876 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8a18ee6-cfce-4e50-b75d-067c745071e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:54.552150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8a18ee6-cfce-4e50-b75d-067c745071e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:54.553275 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8a18ee6-cfce-4e50-b75d-067c745071e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:54.887541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d8a18ee6-cfce-4e50-b75d-067c745071e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:54.897858 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d8a18ee6-cfce-4e50-b75d-067c745071e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.370501 Jun 04 18:30:54.898778 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 124/266] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:54 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:55.920526 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-85b2ef0d-0b4b-43c2-b500-b458358eca52 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:55.921823 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-85b2ef0d-0b4b-43c2-b500-b458358eca52 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:55.930290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:55.932530 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85b2ef0d-0b4b-43c2-b500-b458358eca52 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:55.936444 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85b2ef0d-0b4b-43c2-b500-b458358eca52 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:55.937783 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85b2ef0d-0b4b-43c2-b500-b458358eca52 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:55.938409 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85b2ef0d-0b4b-43c2-b500-b458358eca52 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:56.183451 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-85b2ef0d-0b4b-43c2-b500-b458358eca52 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:56.193042 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-85b2ef0d-0b4b-43c2-b500-b458358eca52 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.277607 Jun 04 18:30:56.193671 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 143/267] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:55 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:56.909953 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-24f57183-4820-4094-a48d-b08fe309b6c4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:30:56.912397 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-24f57183-4820-4094-a48d-b08fe309b6c4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:56.922743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-24f57183-4820-4094-a48d-b08fe309b6c4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:56.923238 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-24f57183-4820-4094-a48d-b08fe309b6c4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:56.924235 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-24f57183-4820-4094-a48d-b08fe309b6c4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:56.924671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-24f57183-4820-4094-a48d-b08fe309b6c4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:56.949845 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-24f57183-4820-4094-a48d-b08fe309b6c4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lazy-loading 'flavor' on Instance uuid 3b484f9b-4abe-452f-9b72-0be6e5f44785 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:30:57.080470 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-24f57183-4820-4094-a48d-b08fe309b6c4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785/action" status: 200 len: 32 microversion: 2.1 time: 0.177541 Jun 04 18:30:57.081174 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 125/268] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:30:56 2022] POST /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:30:57.091812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-854167d5-f9e9-4486-bfb4-ca76195e6d8c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:57.093074 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-854167d5-f9e9-4486-bfb4-ca76195e6d8c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:57.100323 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-854167d5-f9e9-4486-bfb4-ca76195e6d8c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:57.101047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-854167d5-f9e9-4486-bfb4-ca76195e6d8c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:57.102123 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-854167d5-f9e9-4486-bfb4-ca76195e6d8c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:57.102728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-854167d5-f9e9-4486-bfb4-ca76195e6d8c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:57.211394 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-10fce2b8-d458-42d4-a84a-690191e85b07 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:57.212401 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-10fce2b8-d458-42d4-a84a-690191e85b07 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:57.225947 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10fce2b8-d458-42d4-a84a-690191e85b07 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:57.229010 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10fce2b8-d458-42d4-a84a-690191e85b07 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:57.229917 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10fce2b8-d458-42d4-a84a-690191e85b07 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:57.232095 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10fce2b8-d458-42d4-a84a-690191e85b07 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:57.545199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10fce2b8-d458-42d4-a84a-690191e85b07 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:57.554527 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-10fce2b8-d458-42d4-a84a-690191e85b07 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.347763 Jun 04 18:30:57.555117 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 126/269] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:57 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:57.701436 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-854167d5-f9e9-4486-bfb4-ca76195e6d8c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:57.709604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-854167d5-f9e9-4486-bfb4-ca76195e6d8c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.622600 Jun 04 18:30:57.712101 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 144/270] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:57 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:58.572839 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c1190f39-5627-4e11-994e-ce04701efa77 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:58.573652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c1190f39-5627-4e11-994e-ce04701efa77 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:58.595683 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c1190f39-5627-4e11-994e-ce04701efa77 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:58.600218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c1190f39-5627-4e11-994e-ce04701efa77 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:58.602169 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c1190f39-5627-4e11-994e-ce04701efa77 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:58.603624 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c1190f39-5627-4e11-994e-ce04701efa77 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:58.729238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-359a5a2a-58da-4dd9-8181-605b30964438 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:58.731865 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-359a5a2a-58da-4dd9-8181-605b30964438 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:58.745845 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-359a5a2a-58da-4dd9-8181-605b30964438 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:58.748193 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-359a5a2a-58da-4dd9-8181-605b30964438 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:58.751359 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-359a5a2a-58da-4dd9-8181-605b30964438 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:58.752516 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-359a5a2a-58da-4dd9-8181-605b30964438 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:58.820597 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c1190f39-5627-4e11-994e-ce04701efa77 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:58.833223 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c1190f39-5627-4e11-994e-ce04701efa77 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.263442 Jun 04 18:30:58.833835 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 127/271] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:58 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:30:59.075308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-359a5a2a-58da-4dd9-8181-605b30964438 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:30:59.083763 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-359a5a2a-58da-4dd9-8181-605b30964438 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.359256 Jun 04 18:30:59.085034 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 145/272] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:58 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:30:59.444032 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-d105891d-fd21-4b49-b0ef-903bbbfb894d req-59aea049-dae9-4f16-87f6-fb20683e05f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31", "name": "network-vif-plugged", "status": "completed", "tag": "2b7956c3-20c4-469e-ae08-40dda4b0084a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:30:59.468370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d105891d-fd21-4b49-b0ef-903bbbfb894d req-59aea049-dae9-4f16-87f6-fb20683e05f6 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:59.470315 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d105891d-fd21-4b49-b0ef-903bbbfb894d req-59aea049-dae9-4f16-87f6-fb20683e05f6 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:59.493260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-d105891d-fd21-4b49-b0ef-903bbbfb894d req-59aea049-dae9-4f16-87f6-fb20683e05f6 service nova] Creating event network-vif-plugged:2b7956c3-20c4-469e-ae08-40dda4b0084a for instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 on hv-cinder-79053 Jun 04 18:30:59.515634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-d105891d-fd21-4b49-b0ef-903bbbfb894d req-59aea049-dae9-4f16-87f6-fb20683e05f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074686 Jun 04 18:30:59.517199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 128/273] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:30:59.850947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-559982aa-8b96-42a8-ad53-822b4f37b963 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:30:59.851557 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-559982aa-8b96-42a8-ad53-822b4f37b963 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:30:59.873754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-559982aa-8b96-42a8-ad53-822b4f37b963 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:59.874208 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-559982aa-8b96-42a8-ad53-822b4f37b963 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:30:59.875037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-559982aa-8b96-42a8-ad53-822b4f37b963 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:30:59.875474 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-559982aa-8b96-42a8-ad53-822b4f37b963 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:00.026474 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-559982aa-8b96-42a8-ad53-822b4f37b963 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:00.035331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-559982aa-8b96-42a8-ad53-822b4f37b963 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.188270 Jun 04 18:31:00.035904 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 146/274] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:30:59 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:00.103079 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8eedb0af-5646-4b3b-a1bd-1ca52b264800 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:00.103920 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8eedb0af-5646-4b3b-a1bd-1ca52b264800 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:00.114713 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8eedb0af-5646-4b3b-a1bd-1ca52b264800 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:00.115321 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8eedb0af-5646-4b3b-a1bd-1ca52b264800 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:00.116597 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8eedb0af-5646-4b3b-a1bd-1ca52b264800 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:00.117574 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8eedb0af-5646-4b3b-a1bd-1ca52b264800 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:00.287551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8eedb0af-5646-4b3b-a1bd-1ca52b264800 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:00.307965 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8eedb0af-5646-4b3b-a1bd-1ca52b264800 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.209211 Jun 04 18:31:00.312064 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 129/275] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:00 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:01.053943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a35d5977-5277-444c-a4bb-6032630d1d1b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:01.054642 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a35d5977-5277-444c-a4bb-6032630d1d1b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:01.061058 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a35d5977-5277-444c-a4bb-6032630d1d1b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:01.061517 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a35d5977-5277-444c-a4bb-6032630d1d1b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:01.062286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a35d5977-5277-444c-a4bb-6032630d1d1b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:01.062744 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a35d5977-5277-444c-a4bb-6032630d1d1b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:01.197013 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a35d5977-5277-444c-a4bb-6032630d1d1b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:01.205627 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a35d5977-5277-444c-a4bb-6032630d1d1b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.155423 Jun 04 18:31:01.206260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 147/276] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:01 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:01.325804 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bbc3a668-53bb-431c-a54b-1ba8451c11bc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:01.326499 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bbc3a668-53bb-431c-a54b-1ba8451c11bc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:01.333262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbc3a668-53bb-431c-a54b-1ba8451c11bc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:01.333636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbc3a668-53bb-431c-a54b-1ba8451c11bc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:01.334393 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbc3a668-53bb-431c-a54b-1ba8451c11bc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:01.334816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbc3a668-53bb-431c-a54b-1ba8451c11bc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:01.475297 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bbc3a668-53bb-431c-a54b-1ba8451c11bc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:01.483319 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bbc3a668-53bb-431c-a54b-1ba8451c11bc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.161546 Jun 04 18:31:01.483877 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 130/277] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:01 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:02.222661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2ea2c921-eb2e-4748-9008-64d474cf4d83 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:02.223293 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2ea2c921-eb2e-4748-9008-64d474cf4d83 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:02.229623 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ea2c921-eb2e-4748-9008-64d474cf4d83 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:02.230062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ea2c921-eb2e-4748-9008-64d474cf4d83 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:02.231242 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ea2c921-eb2e-4748-9008-64d474cf4d83 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:02.231672 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ea2c921-eb2e-4748-9008-64d474cf4d83 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:02.373166 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2ea2c921-eb2e-4748-9008-64d474cf4d83 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:02.382495 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2ea2c921-eb2e-4748-9008-64d474cf4d83 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.163552 Jun 04 18:31:02.383254 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 148/278] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:02 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:02.503873 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-163d01fd-cd45-4db1-8dc5-903c29ed198d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:02.504469 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-163d01fd-cd45-4db1-8dc5-903c29ed198d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:02.513834 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-163d01fd-cd45-4db1-8dc5-903c29ed198d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:02.514283 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-163d01fd-cd45-4db1-8dc5-903c29ed198d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:02.515034 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-163d01fd-cd45-4db1-8dc5-903c29ed198d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:02.515463 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-163d01fd-cd45-4db1-8dc5-903c29ed198d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:02.647569 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-163d01fd-cd45-4db1-8dc5-903c29ed198d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:02.655558 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-163d01fd-cd45-4db1-8dc5-903c29ed198d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.157780 Jun 04 18:31:02.656161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 131/279] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:02 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:03.404634 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-747a8493-0510-4811-aac8-2b7ef018ded3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:03.405637 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-747a8493-0510-4811-aac8-2b7ef018ded3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:03.416374 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-747a8493-0510-4811-aac8-2b7ef018ded3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:03.417270 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-747a8493-0510-4811-aac8-2b7ef018ded3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:03.418280 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-747a8493-0510-4811-aac8-2b7ef018ded3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:03.418697 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-747a8493-0510-4811-aac8-2b7ef018ded3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:03.552724 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-747a8493-0510-4811-aac8-2b7ef018ded3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:03.561000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-747a8493-0510-4811-aac8-2b7ef018ded3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.163035 Jun 04 18:31:03.561573 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 149/280] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:03 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:03.673240 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-44b50786-9656-4661-993f-9a3d13605793 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:03.673840 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-44b50786-9656-4661-993f-9a3d13605793 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:03.680525 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-44b50786-9656-4661-993f-9a3d13605793 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:03.680968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-44b50786-9656-4661-993f-9a3d13605793 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:03.681719 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-44b50786-9656-4661-993f-9a3d13605793 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:03.682155 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-44b50786-9656-4661-993f-9a3d13605793 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:03.819519 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-44b50786-9656-4661-993f-9a3d13605793 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:03.827873 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-44b50786-9656-4661-993f-9a3d13605793 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.158498 Jun 04 18:31:03.828476 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 132/281] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:03 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:04.584084 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5877955f-3717-4150-88b1-f9788fda0d0c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:04.584999 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5877955f-3717-4150-88b1-f9788fda0d0c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:04.593639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5877955f-3717-4150-88b1-f9788fda0d0c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:04.594269 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5877955f-3717-4150-88b1-f9788fda0d0c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:04.595538 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5877955f-3717-4150-88b1-f9788fda0d0c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:04.596185 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5877955f-3717-4150-88b1-f9788fda0d0c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:04.746465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5877955f-3717-4150-88b1-f9788fda0d0c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:04.757491 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5877955f-3717-4150-88b1-f9788fda0d0c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1367 microversion: 2.1 time: 0.179198 Jun 04 18:31:04.758329 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 150/282] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:04 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:04.845751 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5cf430b2-0878-47e8-9333-5c8179a922cb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:04.846526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5cf430b2-0878-47e8-9333-5c8179a922cb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:04.853285 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5cf430b2-0878-47e8-9333-5c8179a922cb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:04.853722 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5cf430b2-0878-47e8-9333-5c8179a922cb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:04.854498 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5cf430b2-0878-47e8-9333-5c8179a922cb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:04.854933 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5cf430b2-0878-47e8-9333-5c8179a922cb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:05.010871 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5cf430b2-0878-47e8-9333-5c8179a922cb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:05.019421 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5cf430b2-0878-47e8-9333-5c8179a922cb tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.178133 Jun 04 18:31:05.020327 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 133/283] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:04 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:05.775219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-63bfa98a-0c43-4bf7-a6e6-6c4682cff5a6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:05.775829 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-63bfa98a-0c43-4bf7-a6e6-6c4682cff5a6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:05.781948 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-63bfa98a-0c43-4bf7-a6e6-6c4682cff5a6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:05.782574 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-63bfa98a-0c43-4bf7-a6e6-6c4682cff5a6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:05.783400 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-63bfa98a-0c43-4bf7-a6e6-6c4682cff5a6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:05.783852 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-63bfa98a-0c43-4bf7-a6e6-6c4682cff5a6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:05.933245 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-63bfa98a-0c43-4bf7-a6e6-6c4682cff5a6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:05.936842 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:05.943026 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-63bfa98a-0c43-4bf7-a6e6-6c4682cff5a6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1558 microversion: 2.1 time: 0.171710 Jun 04 18:31:05.943635 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 151/284] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:05 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:05.963933 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5670d52e-9d0f-4f55-b333-7b17d923f2ba tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:05.964507 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5670d52e-9d0f-4f55-b333-7b17d923f2ba tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:05.972236 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5670d52e-9d0f-4f55-b333-7b17d923f2ba tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:05.972781 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5670d52e-9d0f-4f55-b333-7b17d923f2ba tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:05.973587 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5670d52e-9d0f-4f55-b333-7b17d923f2ba tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:05.974019 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5670d52e-9d0f-4f55-b333-7b17d923f2ba tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:06.038309 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6b537d54-359f-4b16-8531-b5bf0dd09d1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:06.039563 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6b537d54-359f-4b16-8531-b5bf0dd09d1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:06.046267 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b537d54-359f-4b16-8531-b5bf0dd09d1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:06.046809 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b537d54-359f-4b16-8531-b5bf0dd09d1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:06.047667 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b537d54-359f-4b16-8531-b5bf0dd09d1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:06.048250 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b537d54-359f-4b16-8531-b5bf0dd09d1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:06.071440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5670d52e-9d0f-4f55-b333-7b17d923f2ba tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111667 Jun 04 18:31:06.072053 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 134/285] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 4 18:31:05 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:06.142691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-264528964", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:06.204176 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] validate_networks() for None {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:31:06.242392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6b537d54-359f-4b16-8531-b5bf0dd09d1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:06.257949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6b537d54-359f-4b16-8531-b5bf0dd09d1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.224447 Jun 04 18:31:06.258771 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 152/286] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:06 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:06.698827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:31:06.699374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:31:06.699854 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:31:06.700293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:31:06.700704 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:31:06.716332 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:06.716796 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:06.718555 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:06.719000 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:06.736615 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Getting quotas for project 9e37d22450ca4de287112487fa563163. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:31:06.741445 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Getting quotas for user e14262d9579e4e4293a2748aa894a94c and project 9e37d22450ca4de287112487fa563163. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:31:06.756306 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:31:06.758849 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:31:06.812387 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-661d34f5-1739-41cd-8759-dd987f83b857 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673671 Jun 04 18:31:06.813758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 135/287] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:31:06.823801 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b67049e1-5c5a-440f-9204-226b7917c4a2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:06.824455 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b67049e1-5c5a-440f-9204-226b7917c4a2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:06.904759 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b67049e1-5c5a-440f-9204-226b7917c4a2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:06.917230 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b67049e1-5c5a-440f-9204-226b7917c4a2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1214 microversion: 2.1 time: 0.097472 Jun 04 18:31:06.917814 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 153/288] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:06 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:07.277843 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c9d27951-4ba1-4e2f-b310-f1c625c0abf2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:07.278371 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c9d27951-4ba1-4e2f-b310-f1c625c0abf2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:07.286080 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9d27951-4ba1-4e2f-b310-f1c625c0abf2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:07.286544 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9d27951-4ba1-4e2f-b310-f1c625c0abf2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:07.287526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9d27951-4ba1-4e2f-b310-f1c625c0abf2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:07.287967 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9d27951-4ba1-4e2f-b310-f1c625c0abf2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:07.697509 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-514d77a2-85d8-4c79-af25-fe38fd4f3a61 req-f24228fc-52e2-4093-b29e-a092dbb0b7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31", "tag": "2b7956c3-20c4-469e-ae08-40dda4b0084a"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:07.709603 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-514d77a2-85d8-4c79-af25-fe38fd4f3a61 req-f24228fc-52e2-4093-b29e-a092dbb0b7a4 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:07.710380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-514d77a2-85d8-4c79-af25-fe38fd4f3a61 req-f24228fc-52e2-4093-b29e-a092dbb0b7a4 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:07.722847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-514d77a2-85d8-4c79-af25-fe38fd4f3a61 req-f24228fc-52e2-4093-b29e-a092dbb0b7a4 service nova] Creating event network-changed:2b7956c3-20c4-469e-ae08-40dda4b0084a for instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 on hv-cinder-79053 Jun 04 18:31:07.728488 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c9d27951-4ba1-4e2f-b310-f1c625c0abf2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:07.729221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-514d77a2-85d8-4c79-af25-fe38fd4f3a61 req-f24228fc-52e2-4093-b29e-a092dbb0b7a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035181 Jun 04 18:31:07.730114 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 154/289] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:31:07.738667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c9d27951-4ba1-4e2f-b310-f1c625c0abf2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.464834 Jun 04 18:31:07.740136 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 136/290] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:07 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:07.938712 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6f3d523d-d7c8-44bd-a8a0-6753c623cb5a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:07.941097 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6f3d523d-d7c8-44bd-a8a0-6753c623cb5a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:07.953831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6f3d523d-d7c8-44bd-a8a0-6753c623cb5a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:07.956101 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6f3d523d-d7c8-44bd-a8a0-6753c623cb5a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:07.958648 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6f3d523d-d7c8-44bd-a8a0-6753c623cb5a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:07.964647 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6f3d523d-d7c8-44bd-a8a0-6753c623cb5a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:08.124477 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6f3d523d-d7c8-44bd-a8a0-6753c623cb5a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:08.137754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6f3d523d-d7c8-44bd-a8a0-6753c623cb5a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1274 microversion: 2.1 time: 0.200938 Jun 04 18:31:08.149214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 155/291] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:07 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:08.759019 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ede1647c-3bdc-4a07-8480-7fcb9ca8a599 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:08.760158 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ede1647c-3bdc-4a07-8480-7fcb9ca8a599 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:08.774872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ede1647c-3bdc-4a07-8480-7fcb9ca8a599 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:08.776318 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ede1647c-3bdc-4a07-8480-7fcb9ca8a599 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:08.778949 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ede1647c-3bdc-4a07-8480-7fcb9ca8a599 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:08.779543 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ede1647c-3bdc-4a07-8480-7fcb9ca8a599 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:09.058713 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ede1647c-3bdc-4a07-8480-7fcb9ca8a599 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:09.074294 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ede1647c-3bdc-4a07-8480-7fcb9ca8a599 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.320534 Jun 04 18:31:09.074894 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 137/292] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:08 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:09.158019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bef9f1ad-b1c4-444f-8a85-4473091c7553 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:09.158832 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bef9f1ad-b1c4-444f-8a85-4473091c7553 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:09.167138 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bef9f1ad-b1c4-444f-8a85-4473091c7553 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:09.167930 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bef9f1ad-b1c4-444f-8a85-4473091c7553 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:09.168813 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bef9f1ad-b1c4-444f-8a85-4473091c7553 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:09.169334 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bef9f1ad-b1c4-444f-8a85-4473091c7553 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:09.254835 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bef9f1ad-b1c4-444f-8a85-4473091c7553 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:09.264337 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bef9f1ad-b1c4-444f-8a85-4473091c7553 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1272 microversion: 2.1 time: 0.109749 Jun 04 18:31:09.279190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 156/293] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:09 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:10.090785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-58021b20-ec6c-4db5-9382-a9d16fae668f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:10.091961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-58021b20-ec6c-4db5-9382-a9d16fae668f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:10.102647 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-58021b20-ec6c-4db5-9382-a9d16fae668f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:10.103097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-58021b20-ec6c-4db5-9382-a9d16fae668f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:10.103876 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-58021b20-ec6c-4db5-9382-a9d16fae668f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:10.104333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-58021b20-ec6c-4db5-9382-a9d16fae668f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:10.262296 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-58021b20-ec6c-4db5-9382-a9d16fae668f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:10.271094 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-58021b20-ec6c-4db5-9382-a9d16fae668f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.184252 Jun 04 18:31:10.271893 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 138/294] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:10 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:10.287837 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0137a667-2aa5-4451-91b3-1391a430e78a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:10.288810 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0137a667-2aa5-4451-91b3-1391a430e78a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:10.294972 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0137a667-2aa5-4451-91b3-1391a430e78a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:10.295681 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0137a667-2aa5-4451-91b3-1391a430e78a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:10.296865 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0137a667-2aa5-4451-91b3-1391a430e78a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:10.297624 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0137a667-2aa5-4451-91b3-1391a430e78a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:10.614235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0137a667-2aa5-4451-91b3-1391a430e78a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:10.623196 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0137a667-2aa5-4451-91b3-1391a430e78a tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.338933 Jun 04 18:31:10.634014 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 157/295] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:10 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:11.283115 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-639079d0-7479-4ab1-b2f6-ab5768f6e81a req-06c4461a-33ad-4630-b558-91d93e687b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10c02ce-c1d0-41f4-9162-69c44890b221", "tag": "66b335d5-1473-4e7b-a5a7-81d0f63b6aa8"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:11.295349 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-abda175b-efe8-4301-91c6-7bbe8c428b70 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:11.307540 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-abda175b-efe8-4301-91c6-7bbe8c428b70 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:11.329225 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abda175b-efe8-4301-91c6-7bbe8c428b70 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:11.329688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abda175b-efe8-4301-91c6-7bbe8c428b70 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:11.330649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abda175b-efe8-4301-91c6-7bbe8c428b70 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:11.331244 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abda175b-efe8-4301-91c6-7bbe8c428b70 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:11.336666 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-639079d0-7479-4ab1-b2f6-ab5768f6e81a req-06c4461a-33ad-4630-b558-91d93e687b92 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:11.337008 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-639079d0-7479-4ab1-b2f6-ab5768f6e81a req-06c4461a-33ad-4630-b558-91d93e687b92 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:11.360644 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-639079d0-7479-4ab1-b2f6-ab5768f6e81a req-06c4461a-33ad-4630-b558-91d93e687b92 service nova] Creating event network-changed:66b335d5-1473-4e7b-a5a7-81d0f63b6aa8 for instance d10c02ce-c1d0-41f4-9162-69c44890b221 on hv-cinder-79053 Jun 04 18:31:11.368748 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-639079d0-7479-4ab1-b2f6-ab5768f6e81a req-06c4461a-33ad-4630-b558-91d93e687b92 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089590 Jun 04 18:31:11.370577 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 139/296] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:11.521382 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-abda175b-efe8-4301-91c6-7bbe8c428b70 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:11.540158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-abda175b-efe8-4301-91c6-7bbe8c428b70 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.243531 Jun 04 18:31:11.555587 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 158/297] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:11 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:11.641253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a4497e0d-a110-4fc6-bf6c-63c7406b8222 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:11.642232 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a4497e0d-a110-4fc6-bf6c-63c7406b8222 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:11.652620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a4497e0d-a110-4fc6-bf6c-63c7406b8222 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:11.653252 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a4497e0d-a110-4fc6-bf6c-63c7406b8222 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:11.654196 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a4497e0d-a110-4fc6-bf6c-63c7406b8222 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:11.654817 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a4497e0d-a110-4fc6-bf6c-63c7406b8222 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:11.892905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a4497e0d-a110-4fc6-bf6c-63c7406b8222 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:11.895450 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:11.910516 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a4497e0d-a110-4fc6-bf6c-63c7406b8222 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.273332 Jun 04 18:31:11.911950 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 140/298] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:11 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:12.565872 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-19d37033-16ea-4b6e-99ac-4aa5ad6bbaf3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:12.567178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-19d37033-16ea-4b6e-99ac-4aa5ad6bbaf3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:12.575868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-19d37033-16ea-4b6e-99ac-4aa5ad6bbaf3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.576534 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-19d37033-16ea-4b6e-99ac-4aa5ad6bbaf3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:12.577619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-19d37033-16ea-4b6e-99ac-4aa5ad6bbaf3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.578333 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-19d37033-16ea-4b6e-99ac-4aa5ad6bbaf3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:12.760756 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-19d37033-16ea-4b6e-99ac-4aa5ad6bbaf3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:12.774171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-19d37033-16ea-4b6e-99ac-4aa5ad6bbaf3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1502 microversion: 2.1 time: 0.213006 Jun 04 18:31:12.774801 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 159/299] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:12 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:12.791517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b38f7985-767c-4a63-abc2-65eef58a8a76"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:12.793230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:12.801419 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.801908 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:12.802727 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.803186 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:12.830626 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] HTTP exception thrown: Cannot 'attach_volume' instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 while it is in vm_state rescued Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Request method failure captured: Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: POST /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785/os-volume_attachments HTTP/1.1 Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 74 Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6RqS-9onUVAQGG50nh-ykJv3ebxr_uOLOGJQQGXHZ5PcA_dRtSeaxeAuLuD9LWANPONJYjTDzvX1VgDiUyQ28PBykZ_enjmoLQV2epMvEDYXX0uhOleqqEw2dKqDYLppBBTJtYIzfeFJA9opK-PIEQeBWOWKHuFxG4JT2kOVxM-W5A Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:31:12.832348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}] Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 30f3cc8f3f964b96b864fc8a7f86481a Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {"volumeAttachment": {"volumeId": "b38f7985-767c-4a63-abc2-65eef58a8a76"}} Jun 04 18:31:12.834027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Cannot 'attach_volume' instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 while it is in vm_state rescued Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'server_id': '3b484f9b-4abe-452f-9b72-0be6e5f44785', 'body': {'volumeAttachment': {'volumeId': 'b38f7985-767c-4a63-abc2-65eef58a8a76'}}} Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:31:12.835013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 while it is in vm_state rescued Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:31:12.836534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:31:12.838096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:31:12.838096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:31:12.838096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 while it is in vm_state rescued Jun 04 18:31:12.838096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:12.838096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Returning 409 to user: Cannot 'attach_volume' instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 while it is in vm_state rescued {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:31:12.838096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-96b014ec-7e62-4e70-b997-00e65847c353 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046707 Jun 04 18:31:12.838096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 141/300] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:31:12 2022] POST /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 18:31:12.843737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c757ed26-4353-4fc2-ade8-0920be0ac1e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:12.844575 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c757ed26-4353-4fc2-ade8-0920be0ac1e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:12.851094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c757ed26-4353-4fc2-ade8-0920be0ac1e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.851665 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c757ed26-4353-4fc2-ade8-0920be0ac1e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:12.852711 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c757ed26-4353-4fc2-ade8-0920be0ac1e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.853256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c757ed26-4353-4fc2-ade8-0920be0ac1e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:12.930713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c757ed26-4353-4fc2-ade8-0920be0ac1e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785/action" status: 202 len: 0 microversion: 2.1 time: 0.090644 Jun 04 18:31:12.931115 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0ef7379e-131b-47a6-b44c-e0b0f979e56e tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:12.934295 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 160/301] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:31:12 2022] POST /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:31:12.934564 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0ef7379e-131b-47a6-b44c-e0b0f979e56e tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:12.939394 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ef7379e-131b-47a6-b44c-e0b0f979e56e tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.940046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ef7379e-131b-47a6-b44c-e0b0f979e56e tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:12.940806 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ef7379e-131b-47a6-b44c-e0b0f979e56e tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.940920 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-53e724ac-cb6d-4961-9f43-f25b35bc2c1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:12.941944 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ef7379e-131b-47a6-b44c-e0b0f979e56e tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:12.942043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-53e724ac-cb6d-4961-9f43-f25b35bc2c1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:12.949563 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-53e724ac-cb6d-4961-9f43-f25b35bc2c1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.950496 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-53e724ac-cb6d-4961-9f43-f25b35bc2c1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:12.951283 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-53e724ac-cb6d-4961-9f43-f25b35bc2c1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:12.951721 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-53e724ac-cb6d-4961-9f43-f25b35bc2c1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:13.107067 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-53e724ac-cb6d-4961-9f43-f25b35bc2c1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:13.115056 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-53e724ac-cb6d-4961-9f43-f25b35bc2c1f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1510 microversion: 2.1 time: 0.179238 Jun 04 18:31:13.115616 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 161/302] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:12 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:13.145915 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0ef7379e-131b-47a6-b44c-e0b0f979e56e tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:13.154651 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0ef7379e-131b-47a6-b44c-e0b0f979e56e tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.228750 Jun 04 18:31:13.155313 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 142/303] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:12 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:14.133790 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1c829c60-29bc-47b4-86e4-1b4e170ebb1c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:14.134645 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1c829c60-29bc-47b4-86e4-1b4e170ebb1c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:14.145439 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c829c60-29bc-47b4-86e4-1b4e170ebb1c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:14.145439 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c829c60-29bc-47b4-86e4-1b4e170ebb1c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:14.145439 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c829c60-29bc-47b4-86e4-1b4e170ebb1c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:14.145439 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c829c60-29bc-47b4-86e4-1b4e170ebb1c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:14.173306 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1e2ac834-cbe1-409c-b64c-2c8dc2c52650 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:14.179535 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1e2ac834-cbe1-409c-b64c-2c8dc2c52650 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:14.187289 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e2ac834-cbe1-409c-b64c-2c8dc2c52650 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:14.187698 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e2ac834-cbe1-409c-b64c-2c8dc2c52650 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:14.188743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e2ac834-cbe1-409c-b64c-2c8dc2c52650 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:14.189453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e2ac834-cbe1-409c-b64c-2c8dc2c52650 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:14.322327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1c829c60-29bc-47b4-86e4-1b4e170ebb1c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:14.333087 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1c829c60-29bc-47b4-86e4-1b4e170ebb1c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1510 microversion: 2.1 time: 0.204232 Jun 04 18:31:14.334112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 162/304] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:14 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:14.351199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1e2ac834-cbe1-409c-b64c-2c8dc2c52650 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:14.358997 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1e2ac834-cbe1-409c-b64c-2c8dc2c52650 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.190041 Jun 04 18:31:14.359566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 143/305] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:14 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:15.351077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dd69928f-d183-47f1-9d87-043dc8719333 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:15.351758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dd69928f-d183-47f1-9d87-043dc8719333 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:15.358258 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dd69928f-d183-47f1-9d87-043dc8719333 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:15.358831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dd69928f-d183-47f1-9d87-043dc8719333 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:15.359598 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dd69928f-d183-47f1-9d87-043dc8719333 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:15.360056 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dd69928f-d183-47f1-9d87-043dc8719333 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:15.380163 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-21518185-35b7-4b60-b0ad-53fbb76748e5 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:15.380781 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-21518185-35b7-4b60-b0ad-53fbb76748e5 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:15.388965 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21518185-35b7-4b60-b0ad-53fbb76748e5 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:15.389484 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21518185-35b7-4b60-b0ad-53fbb76748e5 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:15.390313 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21518185-35b7-4b60-b0ad-53fbb76748e5 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:15.390810 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21518185-35b7-4b60-b0ad-53fbb76748e5 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:15.510821 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dd69928f-d183-47f1-9d87-043dc8719333 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:15.522347 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dd69928f-d183-47f1-9d87-043dc8719333 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1510 microversion: 2.1 time: 0.174994 Jun 04 18:31:15.523349 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 163/306] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:15 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:15.534739 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-21518185-35b7-4b60-b0ad-53fbb76748e5 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:15.543657 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-21518185-35b7-4b60-b0ad-53fbb76748e5 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.170567 Jun 04 18:31:15.544894 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 144/307] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:15 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:16.539576 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8abb5dc6-49ed-4d59-8656-4b4f2200a549 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:16.540137 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8abb5dc6-49ed-4d59-8656-4b4f2200a549 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:16.547477 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8abb5dc6-49ed-4d59-8656-4b4f2200a549 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:16.548331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8abb5dc6-49ed-4d59-8656-4b4f2200a549 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:16.549829 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8abb5dc6-49ed-4d59-8656-4b4f2200a549 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:16.550553 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8abb5dc6-49ed-4d59-8656-4b4f2200a549 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:16.561783 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3a98c0ba-be19-4bc7-80ee-4608439d610c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:16.562379 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3a98c0ba-be19-4bc7-80ee-4608439d610c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:16.579633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a98c0ba-be19-4bc7-80ee-4608439d610c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:16.580215 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a98c0ba-be19-4bc7-80ee-4608439d610c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:16.581272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a98c0ba-be19-4bc7-80ee-4608439d610c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:16.581910 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a98c0ba-be19-4bc7-80ee-4608439d610c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:16.727174 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:16.750070 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:16.821284 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8abb5dc6-49ed-4d59-8656-4b4f2200a549 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:16.828728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8abb5dc6-49ed-4d59-8656-4b4f2200a549 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1510 microversion: 2.1 time: 0.293462 Jun 04 18:31:16.829283 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 164/308] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:16 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:16.833178 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3a98c0ba-be19-4bc7-80ee-4608439d610c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:16.841671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3a98c0ba-be19-4bc7-80ee-4608439d610c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.283755 Jun 04 18:31:16.842435 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 145/309] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:16 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:17.847617 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b7ae9101-a294-4d4a-b7f5-caaa9b762942 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:17.848263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b7ae9101-a294-4d4a-b7f5-caaa9b762942 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:17.850877 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:17.856973 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b7ae9101-a294-4d4a-b7f5-caaa9b762942 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:17.857665 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b7ae9101-a294-4d4a-b7f5-caaa9b762942 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:17.858434 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b7ae9101-a294-4d4a-b7f5-caaa9b762942 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:17.859020 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b7ae9101-a294-4d4a-b7f5-caaa9b762942 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:17.859922 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-db2030e0-9461-436d-92ee-3b622a08293c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:17.860607 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-db2030e0-9461-436d-92ee-3b622a08293c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:17.867528 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db2030e0-9461-436d-92ee-3b622a08293c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:17.867997 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db2030e0-9461-436d-92ee-3b622a08293c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:17.869177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db2030e0-9461-436d-92ee-3b622a08293c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:17.869606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db2030e0-9461-436d-92ee-3b622a08293c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:18.020130 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b7ae9101-a294-4d4a-b7f5-caaa9b762942 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:18.030658 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b7ae9101-a294-4d4a-b7f5-caaa9b762942 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1510 microversion: 2.1 time: 0.188317 Jun 04 18:31:18.031445 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 165/310] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:17 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:18.058019 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-db2030e0-9461-436d-92ee-3b622a08293c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:18.067613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-db2030e0-9461-436d-92ee-3b622a08293c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.212462 Jun 04 18:31:18.068222 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 146/311] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:17 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:19.049377 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e170a097-d339-4070-8295-b05b0ab47176 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:19.050104 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e170a097-d339-4070-8295-b05b0ab47176 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:19.056758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e170a097-d339-4070-8295-b05b0ab47176 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:19.057276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e170a097-d339-4070-8295-b05b0ab47176 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:19.058110 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e170a097-d339-4070-8295-b05b0ab47176 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:19.058754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e170a097-d339-4070-8295-b05b0ab47176 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:19.085426 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d908fa3f-9d49-49c8-a699-62ad607ed0cf tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:19.086606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d908fa3f-9d49-49c8-a699-62ad607ed0cf tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:19.093863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d908fa3f-9d49-49c8-a699-62ad607ed0cf tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:19.094535 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d908fa3f-9d49-49c8-a699-62ad607ed0cf tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:19.095766 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d908fa3f-9d49-49c8-a699-62ad607ed0cf tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:19.096591 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d908fa3f-9d49-49c8-a699-62ad607ed0cf tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:19.242992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e170a097-d339-4070-8295-b05b0ab47176 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:19.253730 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e170a097-d339-4070-8295-b05b0ab47176 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1510 microversion: 2.1 time: 0.208451 Jun 04 18:31:19.254803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 166/312] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:19 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:19.254925 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d908fa3f-9d49-49c8-a699-62ad607ed0cf tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:19.263384 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d908fa3f-9d49-49c8-a699-62ad607ed0cf tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.182524 Jun 04 18:31:19.263947 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 147/313] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:19 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:20.270675 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-9e635fc6-6f68-4b7a-a97b-a9923ce94dad req-90a774b2-2e0d-4bb7-91ea-4db6570e10f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10c02ce-c1d0-41f4-9162-69c44890b221", "name": "network-vif-plugged", "status": "completed", "tag": "66b335d5-1473-4e7b-a5a7-81d0f63b6aa8"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:20.271429 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5c09606f-b2a3-435d-b627-8e18f2989ae4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:20.272128 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5c09606f-b2a3-435d-b627-8e18f2989ae4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:20.276763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:20.282777 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-9e635fc6-6f68-4b7a-a97b-a9923ce94dad req-90a774b2-2e0d-4bb7-91ea-4db6570e10f3 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:20.283849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-9e635fc6-6f68-4b7a-a97b-a9923ce94dad req-90a774b2-2e0d-4bb7-91ea-4db6570e10f3 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:20.284754 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c09606f-b2a3-435d-b627-8e18f2989ae4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:20.285552 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c09606f-b2a3-435d-b627-8e18f2989ae4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:20.286748 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c09606f-b2a3-435d-b627-8e18f2989ae4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:20.287499 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c09606f-b2a3-435d-b627-8e18f2989ae4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:20.309717 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-9e635fc6-6f68-4b7a-a97b-a9923ce94dad req-90a774b2-2e0d-4bb7-91ea-4db6570e10f3 service nova] Creating event network-vif-plugged:66b335d5-1473-4e7b-a5a7-81d0f63b6aa8 for instance d10c02ce-c1d0-41f4-9162-69c44890b221 on hv-cinder-79053 Jun 04 18:31:20.317629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-9e635fc6-6f68-4b7a-a97b-a9923ce94dad req-90a774b2-2e0d-4bb7-91ea-4db6570e10f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050683 Jun 04 18:31:20.318993 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 167/314] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:20.327303 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5aee03ff-82f7-42bf-8b3f-320d949ad245 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:20.328556 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5aee03ff-82f7-42bf-8b3f-320d949ad245 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:20.339141 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5aee03ff-82f7-42bf-8b3f-320d949ad245 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:20.339141 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5aee03ff-82f7-42bf-8b3f-320d949ad245 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:20.339141 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5aee03ff-82f7-42bf-8b3f-320d949ad245 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:20.339141 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5aee03ff-82f7-42bf-8b3f-320d949ad245 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:20.433103 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5c09606f-b2a3-435d-b627-8e18f2989ae4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:20.442147 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5c09606f-b2a3-435d-b627-8e18f2989ae4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1510 microversion: 2.1 time: 0.175358 Jun 04 18:31:20.442720 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 148/315] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:20 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:20.472877 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5aee03ff-82f7-42bf-8b3f-320d949ad245 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:20.480328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5aee03ff-82f7-42bf-8b3f-320d949ad245 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.159061 Jun 04 18:31:20.485563 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 168/316] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:20 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:20.655602 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1365377782", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "networks": [{"uuid": "f1e5e3df-f802-4f85-850f-f9e55828a5e1"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:20.707534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] validate_networks() for [('f1e5e3df-f802-4f85-850f-f9e55828a5e1', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:31:21.072972 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:31:21.073416 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:31:21.073858 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:31:21.074259 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:31:21.074668 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:31:21.085045 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:21.085490 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:21.086271 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:21.086699 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:21.103613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Getting quotas for project b6ed2dc911c44ea0953b7c849e590a8a. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:31:21.108108 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Getting quotas for user d193c0fa3d934ba99e8929b2e2ab65c3 and project b6ed2dc911c44ea0953b7c849e590a8a. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:31:21.120342 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:31:21.122574 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:31:21.173403 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-86124dbd-4928-476c-abe5-f3f77af74bdd tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521661 Jun 04 18:31:21.174374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 149/317] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 18:31:21.184720 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d3fe5f47-15e1-41e1-b7d3-1e89f77e0124 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:21.185459 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d3fe5f47-15e1-41e1-b7d3-1e89f77e0124 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:21.241481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d3fe5f47-15e1-41e1-b7d3-1e89f77e0124 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:21.248934 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d3fe5f47-15e1-41e1-b7d3-1e89f77e0124 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1219 microversion: 2.1 time: 0.068284 Jun 04 18:31:21.250126 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 169/318] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:21 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:21.460441 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2660a08d-03a5-4af8-b079-a9afac35b45e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:21.461056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2660a08d-03a5-4af8-b079-a9afac35b45e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:21.468688 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2660a08d-03a5-4af8-b079-a9afac35b45e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:21.469189 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2660a08d-03a5-4af8-b079-a9afac35b45e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:21.470093 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2660a08d-03a5-4af8-b079-a9afac35b45e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:21.470902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2660a08d-03a5-4af8-b079-a9afac35b45e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:21.500724 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-561ad913-3d58-488e-8036-45efc221325b tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:21.501652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-561ad913-3d58-488e-8036-45efc221325b tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:21.518569 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-561ad913-3d58-488e-8036-45efc221325b tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:21.519030 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-561ad913-3d58-488e-8036-45efc221325b tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:21.519800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-561ad913-3d58-488e-8036-45efc221325b tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:21.520264 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-561ad913-3d58-488e-8036-45efc221325b tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:21.633868 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2660a08d-03a5-4af8-b079-a9afac35b45e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:21.641361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2660a08d-03a5-4af8-b079-a9afac35b45e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1516 microversion: 2.1 time: 0.186445 Jun 04 18:31:21.641958 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 150/319] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:21 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:21.683090 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-561ad913-3d58-488e-8036-45efc221325b tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:21.694865 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:21.707524 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-561ad913-3d58-488e-8036-45efc221325b tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.211961 Jun 04 18:31:21.708133 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 170/320] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:21 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:22.266274 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5b11708b-1d2a-406a-9859-d9619ddfd7e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:22.266879 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5b11708b-1d2a-406a-9859-d9619ddfd7e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:22.273029 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b11708b-1d2a-406a-9859-d9619ddfd7e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:22.273475 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b11708b-1d2a-406a-9859-d9619ddfd7e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:22.274226 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b11708b-1d2a-406a-9859-d9619ddfd7e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:22.274656 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b11708b-1d2a-406a-9859-d9619ddfd7e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:22.337643 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5b11708b-1d2a-406a-9859-d9619ddfd7e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:22.345092 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5b11708b-1d2a-406a-9859-d9619ddfd7e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1223 microversion: 2.1 time: 0.082847 Jun 04 18:31:22.345670 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 151/321] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:22 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:22.726625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7e44a758-20c6-4c87-a534-6f5be3b2a3d2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:22.727269 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7e44a758-20c6-4c87-a534-6f5be3b2a3d2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:22.729548 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=66 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:22.736597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e44a758-20c6-4c87-a534-6f5be3b2a3d2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:22.737157 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e44a758-20c6-4c87-a534-6f5be3b2a3d2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:22.738125 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e44a758-20c6-4c87-a534-6f5be3b2a3d2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:22.738558 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e44a758-20c6-4c87-a534-6f5be3b2a3d2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:22.880204 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7e44a758-20c6-4c87-a534-6f5be3b2a3d2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:22.887765 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7e44a758-20c6-4c87-a534-6f5be3b2a3d2 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1314 microversion: 2.1 time: 0.166629 Jun 04 18:31:22.888334 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 171/322] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:22 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:23.361596 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-020b1c40-b676-43a8-9b8e-db2da339bd42 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:23.362349 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-020b1c40-b676-43a8-9b8e-db2da339bd42 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:23.369337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-020b1c40-b676-43a8-9b8e-db2da339bd42 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:23.369790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-020b1c40-b676-43a8-9b8e-db2da339bd42 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:23.370556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-020b1c40-b676-43a8-9b8e-db2da339bd42 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:23.370995 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-020b1c40-b676-43a8-9b8e-db2da339bd42 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:23.434390 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-020b1c40-b676-43a8-9b8e-db2da339bd42 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:23.442795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-020b1c40-b676-43a8-9b8e-db2da339bd42 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1279 microversion: 2.1 time: 0.085175 Jun 04 18:31:23.443353 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 152/323] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:23 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:23.914017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d79d3fe0-d276-4f6f-be53-1d9aee2db66f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:23.914700 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d79d3fe0-d276-4f6f-be53-1d9aee2db66f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:23.921398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d79d3fe0-d276-4f6f-be53-1d9aee2db66f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:23.921844 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d79d3fe0-d276-4f6f-be53-1d9aee2db66f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:23.922602 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d79d3fe0-d276-4f6f-be53-1d9aee2db66f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:23.923029 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d79d3fe0-d276-4f6f-be53-1d9aee2db66f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:24.047332 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f3f6fa34-fb4b-4500-9a3b-e037907dcca1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'create', calling method: .version_select at 0x7f467e10ed30>, body: {"keypair": {"name": "tempest-keypair-340298638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbrmpZtMknQgLDLcTfkJNtchMD/55OLn5ILjPgRE0YrEDtrcHxJ+IL5kGlRZVrHxrJHKCaa9RVu7J4FWF7qFO7yp+xVhATHXyZl6+8epNBfRBMzHMax082Rfgo1g1rQaw=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:24.062707 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-f3f6fa34-fb4b-4500-9a3b-e037907dcca1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Getting quotas for project a3c5011d10ed45c68dcfe77a09f6d9a1. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:31:24.064597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d79d3fe0-d276-4f6f-be53-1d9aee2db66f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:24.067526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-f3f6fa34-fb4b-4500-9a3b-e037907dcca1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Getting quotas for user 30f3cc8f3f964b96b864fc8a7f86481a and project a3c5011d10ed45c68dcfe77a09f6d9a1. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:31:24.072711 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d79d3fe0-d276-4f6f-be53-1d9aee2db66f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1463 microversion: 2.1 time: 0.163711 Jun 04 18:31:24.073324 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 172/324] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:23 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:24.091118 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f3f6fa34-fb4b-4500-9a3b-e037907dcca1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047505 Jun 04 18:31:24.091646 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 153/325] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:31:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:24.116366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-033ad8cc-8842-4d8c-9357-dcb9440740e8 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:24.116922 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-033ad8cc-8842-4d8c-9357-dcb9440740e8 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:24.124616 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-033ad8cc-8842-4d8c-9357-dcb9440740e8 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:24.125061 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-033ad8cc-8842-4d8c-9357-dcb9440740e8 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:24.126014 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-033ad8cc-8842-4d8c-9357-dcb9440740e8 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:24.126447 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-033ad8cc-8842-4d8c-9357-dcb9440740e8 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:24.154037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-033ad8cc-8842-4d8c-9357-dcb9440740e8 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:31:24.247567 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-033ad8cc-8842-4d8c-9357-dcb9440740e8 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 204 len: 0 microversion: 2.1 time: 0.134942 Jun 04 18:31:24.248298 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 173/326] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:31:24 2022] DELETE /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:31:24.257867 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a02d9ffb-8f7c-44de-a360-759e9be515bc tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:24.258618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a02d9ffb-8f7c-44de-a360-759e9be515bc tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:24.265588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a02d9ffb-8f7c-44de-a360-759e9be515bc tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:24.266032 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a02d9ffb-8f7c-44de-a360-759e9be515bc tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:24.266809 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a02d9ffb-8f7c-44de-a360-759e9be515bc tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:24.267231 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a02d9ffb-8f7c-44de-a360-759e9be515bc tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:24.461696 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b9bd4eb9-8085-4cef-8c6d-15cf7f532e75 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:24.463855 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b9bd4eb9-8085-4cef-8c6d-15cf7f532e75 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:24.477604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9bd4eb9-8085-4cef-8c6d-15cf7f532e75 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:24.478847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9bd4eb9-8085-4cef-8c6d-15cf7f532e75 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:24.480302 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9bd4eb9-8085-4cef-8c6d-15cf7f532e75 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:24.493794 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9bd4eb9-8085-4cef-8c6d-15cf7f532e75 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:24.553143 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a02d9ffb-8f7c-44de-a360-759e9be515bc tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:24.563893 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a02d9ffb-8f7c-44de-a360-759e9be515bc tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1469 microversion: 2.1 time: 0.310189 Jun 04 18:31:24.565517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 154/327] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:24 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1469 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:24.722780 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b9bd4eb9-8085-4cef-8c6d-15cf7f532e75 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:24.731342 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b9bd4eb9-8085-4cef-8c6d-15cf7f532e75 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.275297 Jun 04 18:31:24.731909 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 174/328] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:24 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:25.583621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-984a9192-e58a-4098-800e-1390b398e106 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:25.583997 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-984a9192-e58a-4098-800e-1390b398e106 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:25.590924 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-984a9192-e58a-4098-800e-1390b398e106 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:25.595930 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-984a9192-e58a-4098-800e-1390b398e106 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:25.596836 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-984a9192-e58a-4098-800e-1390b398e106 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:25.597293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-984a9192-e58a-4098-800e-1390b398e106 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:25.689634 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-756898310", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9b1af56-bcdd-404d-8bc1-4951853f69e2"}], "security_groups": [{"name": "tempest-securitygroup--1027722073"}], "key_name": "tempest-keypair-340298638", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:25.823229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-984a9192-e58a-4098-800e-1390b398e106 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:25.832550 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-984a9192-e58a-4098-800e-1390b398e106 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1469 microversion: 2.1 time: 0.254157 Jun 04 18:31:25.834768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 155/329] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:25 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1469 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:25.838963 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] validate_networks() for [('c9b1af56-bcdd-404d-8bc1-4951853f69e2', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:31:25.852482 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1e10dd56-c2d8-4718-910e-05a61c71ea3c tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:25.854150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1e10dd56-c2d8-4718-910e-05a61c71ea3c tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:25.866252 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e10dd56-c2d8-4718-910e-05a61c71ea3c tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:25.866871 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e10dd56-c2d8-4718-910e-05a61c71ea3c tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:25.867819 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e10dd56-c2d8-4718-910e-05a61c71ea3c tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:25.868638 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e10dd56-c2d8-4718-910e-05a61c71ea3c tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:26.102097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1e10dd56-c2d8-4718-910e-05a61c71ea3c tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:26.114533 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1e10dd56-c2d8-4718-910e-05a61c71ea3c tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.276899 Jun 04 18:31:26.116125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 156/330] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:25 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:26.406888 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:31:26.407372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:31:26.407919 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:31:26.408699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:31:26.409343 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:31:26.419581 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:26.420208 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:26.421232 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:26.421724 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:26.441901 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Getting quotas for project a3c5011d10ed45c68dcfe77a09f6d9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:31:26.451027 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Getting quotas for user 30f3cc8f3f964b96b864fc8a7f86481a and project a3c5011d10ed45c68dcfe77a09f6d9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:31:26.463482 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:31:26.465913 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:31:26.514460 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5cf6deff-bbef-4bc1-86f5-23d18755cd41 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.830993 Jun 04 18:31:26.521719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 175/331] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:31:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 18:31:26.525939 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c51f31db-698c-423d-ad98-29ccb36bf4f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:26.526589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c51f31db-698c-423d-ad98-29ccb36bf4f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:26.672534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c51f31db-698c-423d-ad98-29ccb36bf4f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:26.680763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c51f31db-698c-423d-ad98-29ccb36bf4f2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1244 microversion: 2.1 time: 0.158731 Jun 04 18:31:26.681713 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 157/332] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:26 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1244 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:26.850511 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-66763c05-2e82-4cb9-846f-7f92a14f3158 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:26.851119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-66763c05-2e82-4cb9-846f-7f92a14f3158 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:26.860556 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66763c05-2e82-4cb9-846f-7f92a14f3158 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:26.861087 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66763c05-2e82-4cb9-846f-7f92a14f3158 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:26.862114 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66763c05-2e82-4cb9-846f-7f92a14f3158 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:26.862620 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66763c05-2e82-4cb9-846f-7f92a14f3158 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:26.931870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-66763c05-2e82-4cb9-846f-7f92a14f3158 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:26.942502 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-66763c05-2e82-4cb9-846f-7f92a14f3158 tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1427 microversion: 2.1 time: 0.096001 Jun 04 18:31:26.952262 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 176/333] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:26 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:27.137956 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-f0efc323-395f-4abb-ad5d-00344cd8eed2 req-c962c242-e4cd-4c1d-aa68-464cb1c2b8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91304396-821c-4f27-9299-359438ac6635", "tag": "1c409352-245f-49d5-b9f1-78883d391677"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:27.139373 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-474bfbbb-29f9-4925-a0c2-27dda7114c91 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:27.141533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-474bfbbb-29f9-4925-a0c2-27dda7114c91 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:27.161202 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-474bfbbb-29f9-4925-a0c2-27dda7114c91 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:27.161724 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-474bfbbb-29f9-4925-a0c2-27dda7114c91 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:27.166512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-474bfbbb-29f9-4925-a0c2-27dda7114c91 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:27.166978 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-474bfbbb-29f9-4925-a0c2-27dda7114c91 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:27.176786 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f0efc323-395f-4abb-ad5d-00344cd8eed2 req-c962c242-e4cd-4c1d-aa68-464cb1c2b8c3 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:27.177264 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f0efc323-395f-4abb-ad5d-00344cd8eed2 req-c962c242-e4cd-4c1d-aa68-464cb1c2b8c3 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:27.203576 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-f0efc323-395f-4abb-ad5d-00344cd8eed2 req-c962c242-e4cd-4c1d-aa68-464cb1c2b8c3 service nova] Creating event network-changed:1c409352-245f-49d5-b9f1-78883d391677 for instance 91304396-821c-4f27-9299-359438ac6635 on hv-cinder-79053 Jun 04 18:31:27.209877 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-f0efc323-395f-4abb-ad5d-00344cd8eed2 req-c962c242-e4cd-4c1d-aa68-464cb1c2b8c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079422 Jun 04 18:31:27.210924 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 158/334] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:27.342685 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-474bfbbb-29f9-4925-a0c2-27dda7114c91 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:27.350516 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-474bfbbb-29f9-4925-a0c2-27dda7114c91 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.221371 Jun 04 18:31:27.351119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 177/335] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:27 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:27.700319 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9a295722-d21e-439c-ae02-e90d77eea365 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:27.701921 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9a295722-d21e-439c-ae02-e90d77eea365 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:27.710313 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9a295722-d21e-439c-ae02-e90d77eea365 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:27.711056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9a295722-d21e-439c-ae02-e90d77eea365 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:27.713680 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9a295722-d21e-439c-ae02-e90d77eea365 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:27.714323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9a295722-d21e-439c-ae02-e90d77eea365 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:27.795452 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9a295722-d21e-439c-ae02-e90d77eea365 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:27.804310 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9a295722-d21e-439c-ae02-e90d77eea365 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1314 microversion: 2.1 time: 0.109787 Jun 04 18:31:27.805033 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 159/336] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:27 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1314 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:27.962074 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:27.964257 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:27.973104 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:27.973585 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:27.974356 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:27.974794 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:28.007136 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:28.007599 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:28.008090 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lazy-loading 'fault' on Instance uuid d10c02ce-c1d0-41f4-9162-69c44890b221 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:31:28.054455 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14262d9579e4e4293a2748aa894a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e37d22450ca4de287112487fa563163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:28.063437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-35aa1a63-c3db-4234-9b3b-7691a58b981f tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 200 len: 1304 microversion: 2.1 time: 0.106893 Jun 04 18:31:28.064052 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 178/337] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:27 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:28.367834 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-57b52ebf-7172-41d0-9635-96c1024d0769 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:28.368512 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-57b52ebf-7172-41d0-9635-96c1024d0769 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:28.374735 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-57b52ebf-7172-41d0-9635-96c1024d0769 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:28.375189 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-57b52ebf-7172-41d0-9635-96c1024d0769 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:28.375953 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-57b52ebf-7172-41d0-9635-96c1024d0769 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:28.376384 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-57b52ebf-7172-41d0-9635-96c1024d0769 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:28.567668 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-57b52ebf-7172-41d0-9635-96c1024d0769 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:28.578250 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-57b52ebf-7172-41d0-9635-96c1024d0769 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.214297 Jun 04 18:31:28.579249 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 160/338] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:28 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:28.821443 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ca3d439f-b0db-4b3a-8264-ef2198f159c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:28.821999 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ca3d439f-b0db-4b3a-8264-ef2198f159c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:28.828225 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca3d439f-b0db-4b3a-8264-ef2198f159c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:28.828659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca3d439f-b0db-4b3a-8264-ef2198f159c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:28.829413 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca3d439f-b0db-4b3a-8264-ef2198f159c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:28.829829 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca3d439f-b0db-4b3a-8264-ef2198f159c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:28.969425 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ca3d439f-b0db-4b3a-8264-ef2198f159c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:28.978291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ca3d439f-b0db-4b3a-8264-ef2198f159c8 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.160856 Jun 04 18:31:28.978884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 179/339] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:28 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:29.083500 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:29.084325 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] [instance: d10c02ce-c1d0-41f4-9162-69c44890b221] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:29.094679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:29.095046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:29.095982 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:29.096906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:29.102199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:29.117117 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] HTTP exception thrown: Instance d10c02ce-c1d0-41f4-9162-69c44890b221 could not be found. Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Request method failure captured: Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 HTTP/1.1 Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6TkzmRufZx0oLOhH0P_0bSm1bMVWwl8KVA0dC2A8BdbNS5I1V3nAUP1iy6xAlzJ7B9R1DILxR9AziennTsnbDBZqMToIEG4w8H-l6Iiv8YEJCwKoOmDGX9w3WQKGox-HCftPB38YIjAxrVxjMFCTgGaN3PM7JwbSl0ZzgvwYaRU-zE Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 9e37d22450ca4de287112487fa563163 Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesNegativeTest-71730025 Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:31:29.119116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e37d22450ca4de287112487fa563163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e37d22450ca4de287112487fa563163"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e37d22450ca4de287112487fa563163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e37d22450ca4de287112487fa563163"}]}] Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesNegativeTest-71730025 Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 9e37d22450ca4de287112487fa563163 Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesNegativeTest-71730025 Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesNegativeTest-71730025-project Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: e14262d9579e4e4293a2748aa894a94c Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesNegativeTest-71730025-project Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance d10c02ce-c1d0-41f4-9162-69c44890b221 could not be found. Jun 04 18:31:29.120641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'd10c02ce-c1d0-41f4-9162-69c44890b221'} Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d10c02ce-c1d0-41f4-9162-69c44890b221 could not be found. Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:31:29.121541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d10c02ce-c1d0-41f4-9162-69c44890b221 could not be found. Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d10c02ce-c1d0-41f4-9162-69c44890b221 could not be found. Jun 04 18:31:29.122906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:31:29.124167 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] Returning 404 to user: Instance d10c02ce-c1d0-41f4-9162-69c44890b221 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:31:29.124167 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-78134719-24c3-4662-ae43-1f197a83936c tempest-VolumesNegativeTest-71730025 tempest-VolumesNegativeTest-71730025-project] 10.222.0.39 "GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221" status: 404 len: 111 microversion: 2.1 time: 0.042523 Jun 04 18:31:29.124167 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 161/340] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:29 2022] GET /compute/v2.1/servers/d10c02ce-c1d0-41f4-9162-69c44890b221 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:31:29.246779 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-90dc04de-ae50-4c3e-9778-2f0b3930b3ce req-1edf4532-878a-4dd0-b193-a9ed7159640a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10c02ce-c1d0-41f4-9162-69c44890b221", "name": "network-vif-deleted", "tag": "66b335d5-1473-4e7b-a5a7-81d0f63b6aa8"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:29.255575 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-90dc04de-ae50-4c3e-9778-2f0b3930b3ce req-1edf4532-878a-4dd0-b193-a9ed7159640a service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:29.256040 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-90dc04de-ae50-4c3e-9778-2f0b3930b3ce req-1edf4532-878a-4dd0-b193-a9ed7159640a service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:29.267238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-90dc04de-ae50-4c3e-9778-2f0b3930b3ce req-1edf4532-878a-4dd0-b193-a9ed7159640a service nova] Creating event network-vif-deleted:66b335d5-1473-4e7b-a5a7-81d0f63b6aa8 for instance d10c02ce-c1d0-41f4-9162-69c44890b221 on hv-cinder-79053 Jun 04 18:31:29.272397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-90dc04de-ae50-4c3e-9778-2f0b3930b3ce req-1edf4532-878a-4dd0-b193-a9ed7159640a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029318 Jun 04 18:31:29.272989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 180/341] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:29.595634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bf611213-96a4-4f87-9228-ce3735031c95 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:29.596376 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bf611213-96a4-4f87-9228-ce3735031c95 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:29.602802 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf611213-96a4-4f87-9228-ce3735031c95 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:29.603245 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf611213-96a4-4f87-9228-ce3735031c95 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:29.604028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf611213-96a4-4f87-9228-ce3735031c95 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:29.604459 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf611213-96a4-4f87-9228-ce3735031c95 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:29.737564 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bf611213-96a4-4f87-9228-ce3735031c95 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:29.745679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bf611213-96a4-4f87-9228-ce3735031c95 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.154635 Jun 04 18:31:29.746369 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 162/342] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:29 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:29.995580 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ba106008-f3ab-49c0-9c4b-d648aec14089 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:29.996281 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ba106008-f3ab-49c0-9c4b-d648aec14089 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:30.002496 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba106008-f3ab-49c0-9c4b-d648aec14089 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:30.002941 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba106008-f3ab-49c0-9c4b-d648aec14089 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:30.003692 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba106008-f3ab-49c0-9c4b-d648aec14089 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:30.004142 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba106008-f3ab-49c0-9c4b-d648aec14089 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:30.145093 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ba106008-f3ab-49c0-9c4b-d648aec14089 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:30.153354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ba106008-f3ab-49c0-9c4b-d648aec14089 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.162001 Jun 04 18:31:30.153970 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 181/343] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:29 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:30.762567 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0ea6eee9-beb8-48e8-a85b-bdbbfebdebc9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:30.763423 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0ea6eee9-beb8-48e8-a85b-bdbbfebdebc9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:30.771491 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ea6eee9-beb8-48e8-a85b-bdbbfebdebc9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:30.772306 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ea6eee9-beb8-48e8-a85b-bdbbfebdebc9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:30.774150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ea6eee9-beb8-48e8-a85b-bdbbfebdebc9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:30.774713 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ea6eee9-beb8-48e8-a85b-bdbbfebdebc9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:31.094793 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:31.139313 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0ea6eee9-beb8-48e8-a85b-bdbbfebdebc9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:31.153590 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0ea6eee9-beb8-48e8-a85b-bdbbfebdebc9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.393429 Jun 04 18:31:31.154255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 163/344] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:30 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:31.171422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-742d223e-5e14-49e8-8077-6c6891b7a2b2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:31.172280 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-742d223e-5e14-49e8-8077-6c6891b7a2b2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:31.187654 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-742d223e-5e14-49e8-8077-6c6891b7a2b2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:31.188372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-742d223e-5e14-49e8-8077-6c6891b7a2b2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:31.189373 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-742d223e-5e14-49e8-8077-6c6891b7a2b2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:31.190117 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-742d223e-5e14-49e8-8077-6c6891b7a2b2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:31.376935 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-742d223e-5e14-49e8-8077-6c6891b7a2b2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:31.388132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-742d223e-5e14-49e8-8077-6c6891b7a2b2 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.220880 Jun 04 18:31:31.389215 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 182/345] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:31 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:31.900758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-41ba336e-eacc-4606-8d9b-a03d24b7b5bf req-6d5a5737-7473-44b0-af78-109b87a99bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989409f2-e7e3-4010-b525-e7389d3eb160", "tag": "567a5b78-fc36-4e1e-ac0f-a5278d2fcb79"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:31.917774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-41ba336e-eacc-4606-8d9b-a03d24b7b5bf req-6d5a5737-7473-44b0-af78-109b87a99bbe service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:31.917774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-41ba336e-eacc-4606-8d9b-a03d24b7b5bf req-6d5a5737-7473-44b0-af78-109b87a99bbe service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:31.935568 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-41ba336e-eacc-4606-8d9b-a03d24b7b5bf req-6d5a5737-7473-44b0-af78-109b87a99bbe service nova] Creating event network-changed:567a5b78-fc36-4e1e-ac0f-a5278d2fcb79 for instance 989409f2-e7e3-4010-b525-e7389d3eb160 on hv-cinder-79053 Jun 04 18:31:31.942527 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-41ba336e-eacc-4606-8d9b-a03d24b7b5bf req-6d5a5737-7473-44b0-af78-109b87a99bbe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046004 Jun 04 18:31:31.943705 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 164/346] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:32.174022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-72e05b81-ae9b-4f85-a06b-4a47b1e8df87 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:32.178501 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-72e05b81-ae9b-4f85-a06b-4a47b1e8df87 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:32.186430 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72e05b81-ae9b-4f85-a06b-4a47b1e8df87 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:32.187145 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72e05b81-ae9b-4f85-a06b-4a47b1e8df87 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:32.188729 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72e05b81-ae9b-4f85-a06b-4a47b1e8df87 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:32.189371 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72e05b81-ae9b-4f85-a06b-4a47b1e8df87 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:32.409238 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-57bd91a2-93f0-49a3-b510-6382006182c7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:32.411213 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-57bd91a2-93f0-49a3-b510-6382006182c7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:32.425535 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-57bd91a2-93f0-49a3-b510-6382006182c7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:32.428055 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-57bd91a2-93f0-49a3-b510-6382006182c7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:32.429540 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-57bd91a2-93f0-49a3-b510-6382006182c7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:32.430489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-57bd91a2-93f0-49a3-b510-6382006182c7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:32.430960 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-72e05b81-ae9b-4f85-a06b-4a47b1e8df87 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:32.444067 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-72e05b81-ae9b-4f85-a06b-4a47b1e8df87 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.273685 Jun 04 18:31:32.444890 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 183/347] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:32 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:32.679321 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-57bd91a2-93f0-49a3-b510-6382006182c7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:32.687717 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-57bd91a2-93f0-49a3-b510-6382006182c7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.285495 Jun 04 18:31:32.688529 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 165/348] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:32 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:33.462250 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1f699ea5-b9b6-4e5a-beb2-7edcca976421 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:33.463474 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1f699ea5-b9b6-4e5a-beb2-7edcca976421 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:33.472576 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f699ea5-b9b6-4e5a-beb2-7edcca976421 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:33.474910 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f699ea5-b9b6-4e5a-beb2-7edcca976421 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:33.477597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f699ea5-b9b6-4e5a-beb2-7edcca976421 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:33.478206 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f699ea5-b9b6-4e5a-beb2-7edcca976421 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:33.691144 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1f699ea5-b9b6-4e5a-beb2-7edcca976421 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:33.699230 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1f699ea5-b9b6-4e5a-beb2-7edcca976421 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.241515 Jun 04 18:31:33.700579 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 184/349] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:33 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:33.706467 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f23aafa2-9178-42e8-b3a5-02c2278ddf08 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:33.707621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f23aafa2-9178-42e8-b3a5-02c2278ddf08 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:33.725424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f23aafa2-9178-42e8-b3a5-02c2278ddf08 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:33.730038 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f23aafa2-9178-42e8-b3a5-02c2278ddf08 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:33.731219 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f23aafa2-9178-42e8-b3a5-02c2278ddf08 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:33.731848 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f23aafa2-9178-42e8-b3a5-02c2278ddf08 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:33.896431 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f23aafa2-9178-42e8-b3a5-02c2278ddf08 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:33.904465 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f23aafa2-9178-42e8-b3a5-02c2278ddf08 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.203452 Jun 04 18:31:33.905433 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 166/350] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:33 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:34.398878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-1e3af722-8bb6-4a87-8b48-5f5738db7f8d req-4f603baf-e44f-432d-854d-04b5fd59307b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91304396-821c-4f27-9299-359438ac6635", "name": "network-vif-plugged", "status": "completed", "tag": "1c409352-245f-49d5-b9f1-78883d391677"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:34.407476 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1e3af722-8bb6-4a87-8b48-5f5738db7f8d req-4f603baf-e44f-432d-854d-04b5fd59307b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:34.408103 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1e3af722-8bb6-4a87-8b48-5f5738db7f8d req-4f603baf-e44f-432d-854d-04b5fd59307b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:34.421764 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-1e3af722-8bb6-4a87-8b48-5f5738db7f8d req-4f603baf-e44f-432d-854d-04b5fd59307b service nova] Creating event network-vif-plugged:1c409352-245f-49d5-b9f1-78883d391677 for instance 91304396-821c-4f27-9299-359438ac6635 on hv-cinder-79053 Jun 04 18:31:34.429339 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-1e3af722-8bb6-4a87-8b48-5f5738db7f8d req-4f603baf-e44f-432d-854d-04b5fd59307b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034816 Jun 04 18:31:34.430218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 185/351] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:34.717153 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f15efe7a-c6c3-499d-a486-139a5408f17d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:34.717761 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f15efe7a-c6c3-499d-a486-139a5408f17d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:34.730891 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f15efe7a-c6c3-499d-a486-139a5408f17d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:34.731132 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f15efe7a-c6c3-499d-a486-139a5408f17d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:34.732091 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f15efe7a-c6c3-499d-a486-139a5408f17d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:34.732531 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f15efe7a-c6c3-499d-a486-139a5408f17d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:34.868828 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f15efe7a-c6c3-499d-a486-139a5408f17d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:34.876615 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f15efe7a-c6c3-499d-a486-139a5408f17d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.163445 Jun 04 18:31:34.880031 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 167/352] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:34 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:34.922520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7ed0cc2e-b91c-406c-ae24-d32db3fad373 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:34.923209 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7ed0cc2e-b91c-406c-ae24-d32db3fad373 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:34.929611 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc2e-b91c-406c-ae24-d32db3fad373 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:34.930063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc2e-b91c-406c-ae24-d32db3fad373 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:34.930878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc2e-b91c-406c-ae24-d32db3fad373 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:34.931317 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc2e-b91c-406c-ae24-d32db3fad373 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:35.076991 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7ed0cc2e-b91c-406c-ae24-d32db3fad373 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:35.084695 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7ed0cc2e-b91c-406c-ae24-d32db3fad373 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.166327 Jun 04 18:31:35.085258 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 186/353] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:34 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:35.895176 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9040d569-f24e-489d-bad9-6ddb5143c9a6 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:35.896046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9040d569-f24e-489d-bad9-6ddb5143c9a6 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:35.902812 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9040d569-f24e-489d-bad9-6ddb5143c9a6 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:35.903465 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9040d569-f24e-489d-bad9-6ddb5143c9a6 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:35.904581 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9040d569-f24e-489d-bad9-6ddb5143c9a6 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:35.905167 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9040d569-f24e-489d-bad9-6ddb5143c9a6 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:36.047653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9040d569-f24e-489d-bad9-6ddb5143c9a6 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:36.056325 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9040d569-f24e-489d-bad9-6ddb5143c9a6 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.165825 Jun 04 18:31:36.057439 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 168/354] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:35 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:36.102490 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-84d7259e-32db-4758-b776-e704bc98f1d1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:36.103281 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-84d7259e-32db-4758-b776-e704bc98f1d1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:36.109898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84d7259e-32db-4758-b776-e704bc98f1d1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:36.110456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84d7259e-32db-4758-b776-e704bc98f1d1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:36.111322 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84d7259e-32db-4758-b776-e704bc98f1d1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:36.112691 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84d7259e-32db-4758-b776-e704bc98f1d1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:36.133319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:36.371871 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84d7259e-32db-4758-b776-e704bc98f1d1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:36.380416 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-84d7259e-32db-4758-b776-e704bc98f1d1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.281786 Jun 04 18:31:36.381628 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 187/355] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:36 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:37.077440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dadc65dd-009d-4d8b-9889-1e8da1fe69fe tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:37.078708 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dadc65dd-009d-4d8b-9889-1e8da1fe69fe tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:37.081152 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=12 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:37.090341 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dadc65dd-009d-4d8b-9889-1e8da1fe69fe tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:37.091013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dadc65dd-009d-4d8b-9889-1e8da1fe69fe tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:37.091950 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dadc65dd-009d-4d8b-9889-1e8da1fe69fe tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:37.092408 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dadc65dd-009d-4d8b-9889-1e8da1fe69fe tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:37.252796 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dadc65dd-009d-4d8b-9889-1e8da1fe69fe tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:37.263552 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dadc65dd-009d-4d8b-9889-1e8da1fe69fe tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.190352 Jun 04 18:31:37.264741 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 169/356] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:37 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:37.398518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e57bcebc-6404-4735-9693-606d9d04bb4b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:37.399088 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e57bcebc-6404-4735-9693-606d9d04bb4b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:37.400975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:37.401620 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=8 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:37.423389 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e57bcebc-6404-4735-9693-606d9d04bb4b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:37.424288 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e57bcebc-6404-4735-9693-606d9d04bb4b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:37.425511 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e57bcebc-6404-4735-9693-606d9d04bb4b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:37.426096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e57bcebc-6404-4735-9693-606d9d04bb4b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:37.592390 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e57bcebc-6404-4735-9693-606d9d04bb4b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:37.600948 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e57bcebc-6404-4735-9693-606d9d04bb4b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.206402 Jun 04 18:31:37.607023 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 188/357] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:37 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:38.280371 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e2ca6a57-3ce5-41a3-b727-c855148d933a tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:38.280956 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e2ca6a57-3ce5-41a3-b727-c855148d933a tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:38.287688 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2ca6a57-3ce5-41a3-b727-c855148d933a tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:38.288485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2ca6a57-3ce5-41a3-b727-c855148d933a tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:38.289531 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2ca6a57-3ce5-41a3-b727-c855148d933a tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:38.290149 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2ca6a57-3ce5-41a3-b727-c855148d933a tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:38.485530 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e2ca6a57-3ce5-41a3-b727-c855148d933a tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:38.494726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e2ca6a57-3ce5-41a3-b727-c855148d933a tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.217951 Jun 04 18:31:38.506229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 170/358] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:38 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:38.627511 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c179d5b7-a656-4eba-8a23-628784790aba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:38.628335 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c179d5b7-a656-4eba-8a23-628784790aba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:38.634691 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c179d5b7-a656-4eba-8a23-628784790aba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:38.635368 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c179d5b7-a656-4eba-8a23-628784790aba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:38.636506 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c179d5b7-a656-4eba-8a23-628784790aba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:38.637143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c179d5b7-a656-4eba-8a23-628784790aba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:38.825025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c179d5b7-a656-4eba-8a23-628784790aba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:38.842900 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c179d5b7-a656-4eba-8a23-628784790aba tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.222638 Jun 04 18:31:38.855800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 189/359] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:38 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:39.513959 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dd679827-9ec5-4959-b7ea-dcd18cf5a8ef tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:39.515680 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dd679827-9ec5-4959-b7ea-dcd18cf5a8ef tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:39.536774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dd679827-9ec5-4959-b7ea-dcd18cf5a8ef tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:39.537545 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dd679827-9ec5-4959-b7ea-dcd18cf5a8ef tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:39.538873 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dd679827-9ec5-4959-b7ea-dcd18cf5a8ef tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:39.539459 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dd679827-9ec5-4959-b7ea-dcd18cf5a8ef tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:39.820047 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dd679827-9ec5-4959-b7ea-dcd18cf5a8ef tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:39.828320 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dd679827-9ec5-4959-b7ea-dcd18cf5a8ef tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.319858 Jun 04 18:31:39.829129 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 171/360] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:39 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:39.861038 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9c6a424a-984d-4a49-b0c5-f014498c6c4c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:39.861707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9c6a424a-984d-4a49-b0c5-f014498c6c4c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:39.873107 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c6a424a-984d-4a49-b0c5-f014498c6c4c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:39.873562 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c6a424a-984d-4a49-b0c5-f014498c6c4c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:39.874338 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c6a424a-984d-4a49-b0c5-f014498c6c4c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:39.874773 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c6a424a-984d-4a49-b0c5-f014498c6c4c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:40.023608 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9c6a424a-984d-4a49-b0c5-f014498c6c4c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:40.033479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9c6a424a-984d-4a49-b0c5-f014498c6c4c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.176970 Jun 04 18:31:40.034655 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 190/361] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:39 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:40.847171 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c8e15e03-7a72-4496-beef-af3fb99bdf60 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:40.848398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c8e15e03-7a72-4496-beef-af3fb99bdf60 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:40.855450 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8e15e03-7a72-4496-beef-af3fb99bdf60 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:40.856130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8e15e03-7a72-4496-beef-af3fb99bdf60 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:40.857292 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8e15e03-7a72-4496-beef-af3fb99bdf60 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:40.857712 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8e15e03-7a72-4496-beef-af3fb99bdf60 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:41.015509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c8e15e03-7a72-4496-beef-af3fb99bdf60 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:41.039939 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c8e15e03-7a72-4496-beef-af3fb99bdf60 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.197849 Jun 04 18:31:41.040545 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 172/362] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:40 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:41.052842 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ef93ee26-f10a-47c2-9e2b-874cb22ab904 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:41.053528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ef93ee26-f10a-47c2-9e2b-874cb22ab904 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:41.062895 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef93ee26-f10a-47c2-9e2b-874cb22ab904 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:41.064147 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef93ee26-f10a-47c2-9e2b-874cb22ab904 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:41.065347 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef93ee26-f10a-47c2-9e2b-874cb22ab904 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:41.065947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef93ee26-f10a-47c2-9e2b-874cb22ab904 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:41.374112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ef93ee26-f10a-47c2-9e2b-874cb22ab904 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:41.382470 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ef93ee26-f10a-47c2-9e2b-874cb22ab904 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.334262 Jun 04 18:31:41.383042 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 191/363] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:41 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:42.056922 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fa20057d-3a3f-4101-a66a-5553b35ba57b tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:42.057522 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fa20057d-3a3f-4101-a66a-5553b35ba57b tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:42.064478 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa20057d-3a3f-4101-a66a-5553b35ba57b tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:42.065334 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa20057d-3a3f-4101-a66a-5553b35ba57b tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:42.065788 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa20057d-3a3f-4101-a66a-5553b35ba57b tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:42.066229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa20057d-3a3f-4101-a66a-5553b35ba57b tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:42.234753 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fa20057d-3a3f-4101-a66a-5553b35ba57b tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:42.244460 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fa20057d-3a3f-4101-a66a-5553b35ba57b tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.191273 Jun 04 18:31:42.249390 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 173/364] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:42 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:42.399460 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7eca609d-201a-4571-9f6b-2c0fac6ea4e0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:42.400229 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7eca609d-201a-4571-9f6b-2c0fac6ea4e0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:42.410569 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eca609d-201a-4571-9f6b-2c0fac6ea4e0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:42.414735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eca609d-201a-4571-9f6b-2c0fac6ea4e0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:42.417408 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eca609d-201a-4571-9f6b-2c0fac6ea4e0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:42.418712 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eca609d-201a-4571-9f6b-2c0fac6ea4e0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:42.709482 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7eca609d-201a-4571-9f6b-2c0fac6ea4e0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:42.733010 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7eca609d-201a-4571-9f6b-2c0fac6ea4e0 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.337194 Jun 04 18:31:42.734541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 192/365] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:42 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:43.274288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c334dc30-0dec-4e41-bd32-9ecdbb395ec4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:43.275168 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c334dc30-0dec-4e41-bd32-9ecdbb395ec4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:43.294272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c334dc30-0dec-4e41-bd32-9ecdbb395ec4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:43.297274 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c334dc30-0dec-4e41-bd32-9ecdbb395ec4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:43.298372 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c334dc30-0dec-4e41-bd32-9ecdbb395ec4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:43.301279 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c334dc30-0dec-4e41-bd32-9ecdbb395ec4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:43.662071 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c334dc30-0dec-4e41-bd32-9ecdbb395ec4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:43.676863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c334dc30-0dec-4e41-bd32-9ecdbb395ec4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.418576 Jun 04 18:31:43.686373 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 174/366] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:43 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:43.751281 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f56ba827-daf9-479b-b653-404d83fc762c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:43.751965 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f56ba827-daf9-479b-b653-404d83fc762c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:43.758708 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f56ba827-daf9-479b-b653-404d83fc762c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:43.759146 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f56ba827-daf9-479b-b653-404d83fc762c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:43.766115 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f56ba827-daf9-479b-b653-404d83fc762c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:43.766844 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f56ba827-daf9-479b-b653-404d83fc762c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:44.007771 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f56ba827-daf9-479b-b653-404d83fc762c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:44.018353 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f56ba827-daf9-479b-b653-404d83fc762c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.271168 Jun 04 18:31:44.019291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 193/367] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:43 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:44.693755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f0f02a4f-42da-47cf-91f8-062fc8463964 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:44.694345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f0f02a4f-42da-47cf-91f8-062fc8463964 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:44.701356 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f0f02a4f-42da-47cf-91f8-062fc8463964 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:44.702092 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f0f02a4f-42da-47cf-91f8-062fc8463964 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:44.702875 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f0f02a4f-42da-47cf-91f8-062fc8463964 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:44.703300 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f0f02a4f-42da-47cf-91f8-062fc8463964 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:45.035387 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f0f02a4f-42da-47cf-91f8-062fc8463964 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:45.045824 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-135130b1-6db9-4635-931b-3d1b2c9f3faa tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:45.048401 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-135130b1-6db9-4635-931b-3d1b2c9f3faa tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:45.067749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f0f02a4f-42da-47cf-91f8-062fc8463964 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.377332 Jun 04 18:31:45.070206 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-135130b1-6db9-4635-931b-3d1b2c9f3faa tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:45.070665 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-135130b1-6db9-4635-931b-3d1b2c9f3faa tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:45.071617 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-135130b1-6db9-4635-931b-3d1b2c9f3faa tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:45.072178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-135130b1-6db9-4635-931b-3d1b2c9f3faa tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:45.080366 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 175/368] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:44 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:45.259246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-135130b1-6db9-4635-931b-3d1b2c9f3faa tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:45.268899 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-135130b1-6db9-4635-931b-3d1b2c9f3faa tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.236725 Jun 04 18:31:45.276367 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 194/369] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:45 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:31:45.839892 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-d5a01b74-e190-45d5-8473-28b01831ad74 req-f54ea17c-f6af-4cf3-8e12-4422b5a42293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989409f2-e7e3-4010-b525-e7389d3eb160", "name": "network-vif-plugged", "status": "completed", "tag": "567a5b78-fc36-4e1e-ac0f-a5278d2fcb79"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:45.856225 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d5a01b74-e190-45d5-8473-28b01831ad74 req-f54ea17c-f6af-4cf3-8e12-4422b5a42293 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:45.856911 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d5a01b74-e190-45d5-8473-28b01831ad74 req-f54ea17c-f6af-4cf3-8e12-4422b5a42293 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:45.869167 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-d5a01b74-e190-45d5-8473-28b01831ad74 req-f54ea17c-f6af-4cf3-8e12-4422b5a42293 service nova] Creating event network-vif-plugged:567a5b78-fc36-4e1e-ac0f-a5278d2fcb79 for instance 989409f2-e7e3-4010-b525-e7389d3eb160 on hv-cinder-79053 Jun 04 18:31:45.874534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-d5a01b74-e190-45d5-8473-28b01831ad74 req-f54ea17c-f6af-4cf3-8e12-4422b5a42293 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042957 Jun 04 18:31:45.875235 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 176/370] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:46.086838 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-992cfdb5-ca3a-4443-9fa8-6eec19ccdbd9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:46.087286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-992cfdb5-ca3a-4443-9fa8-6eec19ccdbd9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:46.093780 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-992cfdb5-ca3a-4443-9fa8-6eec19ccdbd9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:46.094223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-992cfdb5-ca3a-4443-9fa8-6eec19ccdbd9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:46.094995 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-992cfdb5-ca3a-4443-9fa8-6eec19ccdbd9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:46.095458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-992cfdb5-ca3a-4443-9fa8-6eec19ccdbd9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:46.257798 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-992cfdb5-ca3a-4443-9fa8-6eec19ccdbd9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:46.266034 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-992cfdb5-ca3a-4443-9fa8-6eec19ccdbd9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1319 microversion: 2.1 time: 0.183203 Jun 04 18:31:46.266599 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 195/371] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:46 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:46.310978 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-441087a6-344d-4265-b32c-df6bbf4b049b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:46.311627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-441087a6-344d-4265-b32c-df6bbf4b049b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:46.341970 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-441087a6-344d-4265-b32c-df6bbf4b049b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:46.343955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-441087a6-344d-4265-b32c-df6bbf4b049b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:46.345137 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-441087a6-344d-4265-b32c-df6bbf4b049b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:46.345852 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-441087a6-344d-4265-b32c-df6bbf4b049b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:46.700770 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-441087a6-344d-4265-b32c-df6bbf4b049b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:46.713327 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-441087a6-344d-4265-b32c-df6bbf4b049b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.423020 Jun 04 18:31:46.716498 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 177/372] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:46 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:47.285274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d0297a46-3067-4f15-b171-94896e88f341 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:47.286874 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d0297a46-3067-4f15-b171-94896e88f341 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:47.297798 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0297a46-3067-4f15-b171-94896e88f341 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:47.298748 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0297a46-3067-4f15-b171-94896e88f341 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:47.300362 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0297a46-3067-4f15-b171-94896e88f341 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:47.301046 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0297a46-3067-4f15-b171-94896e88f341 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:47.455134 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d0297a46-3067-4f15-b171-94896e88f341 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:47.463671 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d0297a46-3067-4f15-b171-94896e88f341 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1508 microversion: 2.1 time: 0.183527 Jun 04 18:31:47.464275 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 196/373] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:47 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:47.730733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cfb512dd-e239-4571-bc6a-5d3a75bdcaff tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:47.731348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cfb512dd-e239-4571-bc6a-5d3a75bdcaff tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:47.750747 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfb512dd-e239-4571-bc6a-5d3a75bdcaff tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:47.754506 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfb512dd-e239-4571-bc6a-5d3a75bdcaff tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:47.757437 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfb512dd-e239-4571-bc6a-5d3a75bdcaff tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:47.758059 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfb512dd-e239-4571-bc6a-5d3a75bdcaff tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:47.963533 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cfb512dd-e239-4571-bc6a-5d3a75bdcaff tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:47.973099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cfb512dd-e239-4571-bc6a-5d3a75bdcaff tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.246176 Jun 04 18:31:47.973704 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 178/374] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:47 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:48.991490 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-816eab4a-f864-487a-81b1-001f325ded0a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:48.992854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-816eab4a-f864-487a-81b1-001f325ded0a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:48.999831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-816eab4a-f864-487a-81b1-001f325ded0a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:49.000321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-816eab4a-f864-487a-81b1-001f325ded0a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:49.001096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-816eab4a-f864-487a-81b1-001f325ded0a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:49.002166 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-816eab4a-f864-487a-81b1-001f325ded0a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:49.244829 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-816eab4a-f864-487a-81b1-001f325ded0a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:49.257988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-816eab4a-f864-487a-81b1-001f325ded0a tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.271441 Jun 04 18:31:49.258660 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 197/375] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:48 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:50.275897 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5b9ba776-d5fe-4cb4-8e54-6689511b93e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:50.276538 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5b9ba776-d5fe-4cb4-8e54-6689511b93e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:50.283131 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b9ba776-d5fe-4cb4-8e54-6689511b93e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:50.283346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b9ba776-d5fe-4cb4-8e54-6689511b93e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:50.284344 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b9ba776-d5fe-4cb4-8e54-6689511b93e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:50.284946 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b9ba776-d5fe-4cb4-8e54-6689511b93e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:50.443592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5b9ba776-d5fe-4cb4-8e54-6689511b93e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:50.451133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:50.455021 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5b9ba776-d5fe-4cb4-8e54-6689511b93e4 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.183529 Jun 04 18:31:50.456102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 179/376] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:50 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:51.473181 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9bdfff31-43af-4ccb-be8b-be44d021d89c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:51.475127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9bdfff31-43af-4ccb-be8b-be44d021d89c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:51.487015 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9bdfff31-43af-4ccb-be8b-be44d021d89c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:51.489652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9bdfff31-43af-4ccb-be8b-be44d021d89c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:51.491331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9bdfff31-43af-4ccb-be8b-be44d021d89c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:51.491845 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9bdfff31-43af-4ccb-be8b-be44d021d89c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:51.647964 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9bdfff31-43af-4ccb-be8b-be44d021d89c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:51.655702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9bdfff31-43af-4ccb-be8b-be44d021d89c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.186882 Jun 04 18:31:51.656296 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 198/377] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:51 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:52.673217 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f45cca5e-226d-42cc-872c-afe2b8bf2e1e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:52.674685 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f45cca5e-226d-42cc-872c-afe2b8bf2e1e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:52.681452 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:52.683779 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f45cca5e-226d-42cc-872c-afe2b8bf2e1e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:52.684512 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f45cca5e-226d-42cc-872c-afe2b8bf2e1e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:52.685470 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f45cca5e-226d-42cc-872c-afe2b8bf2e1e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:52.685910 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f45cca5e-226d-42cc-872c-afe2b8bf2e1e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:52.834251 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f45cca5e-226d-42cc-872c-afe2b8bf2e1e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:52.844239 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f45cca5e-226d-42cc-872c-afe2b8bf2e1e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1370 microversion: 2.1 time: 0.173022 Jun 04 18:31:52.844833 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 180/378] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:52 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:53.862422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-722c9b06-2f0f-442b-bbdc-37babee56a0c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:53.863858 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-722c9b06-2f0f-442b-bbdc-37babee56a0c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:53.866169 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:53.878411 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-722c9b06-2f0f-442b-bbdc-37babee56a0c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:53.878873 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-722c9b06-2f0f-442b-bbdc-37babee56a0c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:53.879774 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-722c9b06-2f0f-442b-bbdc-37babee56a0c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:53.880233 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-722c9b06-2f0f-442b-bbdc-37babee56a0c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:54.046499 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-722c9b06-2f0f-442b-bbdc-37babee56a0c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:54.057879 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-722c9b06-2f0f-442b-bbdc-37babee56a0c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1565 microversion: 2.1 time: 0.200105 Jun 04 18:31:54.058453 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 199/379] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:53 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1565 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:54.075667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8c0e6c2e-2978-422b-ab47-1711e5e4fa93 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:54.076928 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8c0e6c2e-2978-422b-ab47-1711e5e4fa93 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:54.084588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8c0e6c2e-2978-422b-ab47-1711e5e4fa93 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:54.085024 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8c0e6c2e-2978-422b-ab47-1711e5e4fa93 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:54.085780 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8c0e6c2e-2978-422b-ab47-1711e5e4fa93 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:54.086403 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8c0e6c2e-2978-422b-ab47-1711e5e4fa93 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:54.185368 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8c0e6c2e-2978-422b-ab47-1711e5e4fa93 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113968 Jun 04 18:31:54.186224 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 181/380] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 4 18:31:54 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:55.433343 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-260f58a7-68d1-47e5-8773-ea6230edbae1 req-16f42932-2a86-45a4-b72b-4f4b7f340a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989409f2-e7e3-4010-b525-e7389d3eb160", "tag": "567a5b78-fc36-4e1e-ac0f-a5278d2fcb79"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:55.445252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-260f58a7-68d1-47e5-8773-ea6230edbae1 req-16f42932-2a86-45a4-b72b-4f4b7f340a18 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:55.446110 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-260f58a7-68d1-47e5-8773-ea6230edbae1 req-16f42932-2a86-45a4-b72b-4f4b7f340a18 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:55.466204 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-260f58a7-68d1-47e5-8773-ea6230edbae1 req-16f42932-2a86-45a4-b72b-4f4b7f340a18 service nova] Creating event network-changed:567a5b78-fc36-4e1e-ac0f-a5278d2fcb79 for instance 989409f2-e7e3-4010-b525-e7389d3eb160 on hv-cinder-79053 Jun 04 18:31:55.474309 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-260f58a7-68d1-47e5-8773-ea6230edbae1 req-16f42932-2a86-45a4-b72b-4f4b7f340a18 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047863 Jun 04 18:31:55.479127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 200/381] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:55.765838 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-47c570ea-9d12-4203-b010-50eeea002e97 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Action: 'create', calling method: .version_select at 0x7f467e1c1f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-191988361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhksxjDrlgF1zjCdSDS8xfbeUQ1PlwZNarWNEXS/wsnrIxuJ/63durI7rQIPYYgLTMPdSK1g+GgX9t9lBBTNYSaJf3vwMU1Tl4cR4Bs2l/N787JjHqRqDdBtKICTqrmYg=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:55.784215 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-47c570ea-9d12-4203-b010-50eeea002e97 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Getting quotas for project 5cfb3750227e4037b6e92552361366f4. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:31:55.789005 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-47c570ea-9d12-4203-b010-50eeea002e97 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Getting quotas for user 2e0bd04828eb48bdbfe09fd01130ac73 and project 5cfb3750227e4037b6e92552361366f4. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:31:55.812920 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-47c570ea-9d12-4203-b010-50eeea002e97 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052760 Jun 04 18:31:55.813937 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 182/382] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:31:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:31:55.864383 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-283567892", "imageRef": "df870d7d-d4e0-495c-b134-e760186c6c21", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-191988361", "networks": [{"uuid": "c57a85a1-5585-458b-b795-fbfbefe4ec68"}]}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:31:55.923623 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] validate_networks() for [('c57a85a1-5585-458b-b795-fbfbefe4ec68', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:31:56.358122 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:31:56.358844 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:31:56.359415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:31:56.359892 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:31:56.360501 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:31:56.380117 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:56.380697 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:56.381591 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:56.382140 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:56.410437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Getting quotas for project 5cfb3750227e4037b6e92552361366f4. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:31:56.417900 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Getting quotas for user 2e0bd04828eb48bdbfe09fd01130ac73 and project 5cfb3750227e4037b6e92552361366f4. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:31:56.433810 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:31:56.436523 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df870d7d-d4e0-495c-b134-e760186c6c21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:31:56.497128 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-85aba4e2-d722-42c7-b1ff-a19daeb49d40 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637593 Jun 04 18:31:56.502682 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 201/383] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:31:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:31:56.507726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b24f55bf-34e7-4f5c-8086-644d6ad4f173 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:56.508653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b24f55bf-34e7-4f5c-8086-644d6ad4f173 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:56.635538 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b24f55bf-34e7-4f5c-8086-644d6ad4f173 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:56.656309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b24f55bf-34e7-4f5c-8086-644d6ad4f173 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1257 microversion: 2.1 time: 0.151888 Jun 04 18:31:56.657789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 183/384] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:56 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:57.677879 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6e457927-0ccc-474e-a64a-41d9599dd177 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:57.679110 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6e457927-0ccc-474e-a64a-41d9599dd177 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:57.685984 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e457927-0ccc-474e-a64a-41d9599dd177 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:57.686898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e457927-0ccc-474e-a64a-41d9599dd177 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:57.687660 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e457927-0ccc-474e-a64a-41d9599dd177 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:57.688298 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e457927-0ccc-474e-a64a-41d9599dd177 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:57.791567 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6e457927-0ccc-474e-a64a-41d9599dd177 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:57.799735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6e457927-0ccc-474e-a64a-41d9599dd177 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1317 microversion: 2.1 time: 0.126364 Jun 04 18:31:57.800344 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 202/385] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:57 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1317 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:31:58.828234 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-28cebd8c-5f23-4767-ad85-d1bff780abe5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:31:58.830141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-28cebd8c-5f23-4767-ad85-d1bff780abe5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:31:58.844392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28cebd8c-5f23-4767-ad85-d1bff780abe5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:58.845215 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28cebd8c-5f23-4767-ad85-d1bff780abe5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:58.846848 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28cebd8c-5f23-4767-ad85-d1bff780abe5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:31:58.847737 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28cebd8c-5f23-4767-ad85-d1bff780abe5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:31:59.015492 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-28cebd8c-5f23-4767-ad85-d1bff780abe5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:31:59.026495 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-28cebd8c-5f23-4767-ad85-d1bff780abe5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.212095 Jun 04 18:31:59.036682 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 184/386] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:31:58 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:00.045692 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-953e1bf9-5438-4cc7-9ca7-34e0b36b1d15 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:00.046472 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-953e1bf9-5438-4cc7-9ca7-34e0b36b1d15 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:00.053745 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-953e1bf9-5438-4cc7-9ca7-34e0b36b1d15 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:00.055125 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-953e1bf9-5438-4cc7-9ca7-34e0b36b1d15 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:00.056076 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-953e1bf9-5438-4cc7-9ca7-34e0b36b1d15 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:00.056524 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-953e1bf9-5438-4cc7-9ca7-34e0b36b1d15 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:00.193867 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-953e1bf9-5438-4cc7-9ca7-34e0b36b1d15 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:00.205016 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-953e1bf9-5438-4cc7-9ca7-34e0b36b1d15 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.163593 Jun 04 18:32:00.205590 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 203/387] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:00 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:01.222210 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-acd13200-40b6-4891-9df0-6d9bc63b57fe tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:01.222771 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-acd13200-40b6-4891-9df0-6d9bc63b57fe tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:01.229765 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acd13200-40b6-4891-9df0-6d9bc63b57fe tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:01.230279 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acd13200-40b6-4891-9df0-6d9bc63b57fe tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:01.231142 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acd13200-40b6-4891-9df0-6d9bc63b57fe tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:01.231655 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acd13200-40b6-4891-9df0-6d9bc63b57fe tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:01.381929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-acd13200-40b6-4891-9df0-6d9bc63b57fe tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:01.399684 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-acd13200-40b6-4891-9df0-6d9bc63b57fe tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.181284 Jun 04 18:32:01.401012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 185/388] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:01 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:02.419085 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6e28af90-2cd0-43d2-9c73-8ce3fbe2eeed tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:02.420995 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6e28af90-2cd0-43d2-9c73-8ce3fbe2eeed tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:02.429689 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e28af90-2cd0-43d2-9c73-8ce3fbe2eeed tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:02.430407 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e28af90-2cd0-43d2-9c73-8ce3fbe2eeed tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:02.431352 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e28af90-2cd0-43d2-9c73-8ce3fbe2eeed tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:02.431975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e28af90-2cd0-43d2-9c73-8ce3fbe2eeed tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:02.581058 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6e28af90-2cd0-43d2-9c73-8ce3fbe2eeed tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:02.589352 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6e28af90-2cd0-43d2-9c73-8ce3fbe2eeed tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.175014 Jun 04 18:32:02.598992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 204/389] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:02 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:03.606942 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fa5ec690-5600-44f4-9f27-5a6c09433ff9 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:03.607520 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fa5ec690-5600-44f4-9f27-5a6c09433ff9 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:03.615098 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa5ec690-5600-44f4-9f27-5a6c09433ff9 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:03.615541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa5ec690-5600-44f4-9f27-5a6c09433ff9 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:03.616475 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa5ec690-5600-44f4-9f27-5a6c09433ff9 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:03.616915 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa5ec690-5600-44f4-9f27-5a6c09433ff9 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:03.770407 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fa5ec690-5600-44f4-9f27-5a6c09433ff9 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:03.778479 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fa5ec690-5600-44f4-9f27-5a6c09433ff9 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.175496 Jun 04 18:32:03.779055 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 186/390] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:03 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:04.797289 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f6455a3e-7bee-45eb-beed-a161e61b2b23 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:04.798301 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f6455a3e-7bee-45eb-beed-a161e61b2b23 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:04.808637 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f6455a3e-7bee-45eb-beed-a161e61b2b23 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:04.809256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f6455a3e-7bee-45eb-beed-a161e61b2b23 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:04.810470 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f6455a3e-7bee-45eb-beed-a161e61b2b23 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:04.811169 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f6455a3e-7bee-45eb-beed-a161e61b2b23 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:04.835628 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:04.961168 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f6455a3e-7bee-45eb-beed-a161e61b2b23 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:04.968979 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f6455a3e-7bee-45eb-beed-a161e61b2b23 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.175881 Jun 04 18:32:04.969792 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 205/391] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:04 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:05.990723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2c516e52-b49b-4b0c-af44-bcf8adbe6262 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:05.991365 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2c516e52-b49b-4b0c-af44-bcf8adbe6262 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:05.998556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2c516e52-b49b-4b0c-af44-bcf8adbe6262 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:05.999011 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2c516e52-b49b-4b0c-af44-bcf8adbe6262 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:05.999789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2c516e52-b49b-4b0c-af44-bcf8adbe6262 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:06.000263 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2c516e52-b49b-4b0c-af44-bcf8adbe6262 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:06.138965 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2c516e52-b49b-4b0c-af44-bcf8adbe6262 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:06.147928 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2c516e52-b49b-4b0c-af44-bcf8adbe6262 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.163446 Jun 04 18:32:06.148856 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 187/392] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:05 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:07.167977 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a9a5a453-0f16-47ac-94a4-dec0910b2973 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:07.169818 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a9a5a453-0f16-47ac-94a4-dec0910b2973 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:07.173511 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:07.174455 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:07.180426 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9a5a453-0f16-47ac-94a4-dec0910b2973 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:07.180881 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9a5a453-0f16-47ac-94a4-dec0910b2973 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:07.181855 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9a5a453-0f16-47ac-94a4-dec0910b2973 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:07.182295 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9a5a453-0f16-47ac-94a4-dec0910b2973 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:07.324116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a9a5a453-0f16-47ac-94a4-dec0910b2973 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:07.331767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a9a5a453-0f16-47ac-94a4-dec0910b2973 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.168945 Jun 04 18:32:07.332392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 206/393] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:07 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:08.350813 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b604e6a2-2189-4891-8aae-3c2f9eda6a22 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:08.351465 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b604e6a2-2189-4891-8aae-3c2f9eda6a22 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:08.353718 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:08.359572 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b604e6a2-2189-4891-8aae-3c2f9eda6a22 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:08.360129 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b604e6a2-2189-4891-8aae-3c2f9eda6a22 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:08.360906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b604e6a2-2189-4891-8aae-3c2f9eda6a22 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:08.361345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b604e6a2-2189-4891-8aae-3c2f9eda6a22 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:08.497591 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b604e6a2-2189-4891-8aae-3c2f9eda6a22 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:08.505050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b604e6a2-2189-4891-8aae-3c2f9eda6a22 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.158196 Jun 04 18:32:08.505677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 188/394] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:08 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:09.524165 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a36fb08c-6990-49aa-a8d1-51a7e8c119eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:09.524803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a36fb08c-6990-49aa-a8d1-51a7e8c119eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:09.531147 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a36fb08c-6990-49aa-a8d1-51a7e8c119eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:09.531594 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a36fb08c-6990-49aa-a8d1-51a7e8c119eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:09.532397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a36fb08c-6990-49aa-a8d1-51a7e8c119eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:09.532894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a36fb08c-6990-49aa-a8d1-51a7e8c119eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:09.668407 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a36fb08c-6990-49aa-a8d1-51a7e8c119eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:09.676554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a36fb08c-6990-49aa-a8d1-51a7e8c119eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.158193 Jun 04 18:32:09.677337 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 207/395] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:09 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:10.697077 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-727ea6c6-14ff-40bd-9adc-ac8dd754eee2 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:10.697730 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-727ea6c6-14ff-40bd-9adc-ac8dd754eee2 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:10.704690 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-727ea6c6-14ff-40bd-9adc-ac8dd754eee2 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:10.705586 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-727ea6c6-14ff-40bd-9adc-ac8dd754eee2 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:10.706366 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-727ea6c6-14ff-40bd-9adc-ac8dd754eee2 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:10.706796 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-727ea6c6-14ff-40bd-9adc-ac8dd754eee2 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:10.839599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-727ea6c6-14ff-40bd-9adc-ac8dd754eee2 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:10.851241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-727ea6c6-14ff-40bd-9adc-ac8dd754eee2 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.160430 Jun 04 18:32:10.851797 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 189/396] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:10 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:11.872983 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1ae2c286-9734-416b-9f2f-e01a3ca3df95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:11.873877 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1ae2c286-9734-416b-9f2f-e01a3ca3df95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:11.884335 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ae2c286-9734-416b-9f2f-e01a3ca3df95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:11.885083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ae2c286-9734-416b-9f2f-e01a3ca3df95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:11.886339 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ae2c286-9734-416b-9f2f-e01a3ca3df95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:11.887065 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ae2c286-9734-416b-9f2f-e01a3ca3df95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:12.028962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1ae2c286-9734-416b-9f2f-e01a3ca3df95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:12.041020 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1ae2c286-9734-416b-9f2f-e01a3ca3df95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.174879 Jun 04 18:32:12.041769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 208/397] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:11 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:13.059369 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5289f155-16f9-48b9-b606-6540b8a31b72 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:13.060057 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5289f155-16f9-48b9-b606-6540b8a31b72 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:13.067772 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5289f155-16f9-48b9-b606-6540b8a31b72 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:13.068306 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5289f155-16f9-48b9-b606-6540b8a31b72 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:13.069420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5289f155-16f9-48b9-b606-6540b8a31b72 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:13.070015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5289f155-16f9-48b9-b606-6540b8a31b72 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:13.213177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5289f155-16f9-48b9-b606-6540b8a31b72 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:13.220716 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5289f155-16f9-48b9-b606-6540b8a31b72 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.165712 Jun 04 18:32:13.221280 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 190/398] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:13 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:14.239894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2eb1cf8d-7e3d-4a2c-9db4-da345b6ed070 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:14.241271 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2eb1cf8d-7e3d-4a2c-9db4-da345b6ed070 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:14.248458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2eb1cf8d-7e3d-4a2c-9db4-da345b6ed070 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:14.249110 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2eb1cf8d-7e3d-4a2c-9db4-da345b6ed070 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:14.250256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2eb1cf8d-7e3d-4a2c-9db4-da345b6ed070 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:14.250870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2eb1cf8d-7e3d-4a2c-9db4-da345b6ed070 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:14.397727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2eb1cf8d-7e3d-4a2c-9db4-da345b6ed070 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:14.409473 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2eb1cf8d-7e3d-4a2c-9db4-da345b6ed070 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.174337 Jun 04 18:32:14.410305 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 209/399] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:14 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:15.430370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0f7afbcb-f242-40d5-be84-745098511e5a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:15.431186 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0f7afbcb-f242-40d5-be84-745098511e5a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:15.438670 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f7afbcb-f242-40d5-be84-745098511e5a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:15.439345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f7afbcb-f242-40d5-be84-745098511e5a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:15.440561 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f7afbcb-f242-40d5-be84-745098511e5a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:15.441248 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f7afbcb-f242-40d5-be84-745098511e5a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:15.578102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0f7afbcb-f242-40d5-be84-745098511e5a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:15.593813 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0f7afbcb-f242-40d5-be84-745098511e5a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.168247 Jun 04 18:32:15.594622 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 191/400] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:15 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:16.614754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fe6aabcc-a1cf-40c5-95ae-c840e3c3b337 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:16.615323 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fe6aabcc-a1cf-40c5-95ae-c840e3c3b337 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:16.622582 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe6aabcc-a1cf-40c5-95ae-c840e3c3b337 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:16.623033 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe6aabcc-a1cf-40c5-95ae-c840e3c3b337 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:16.623800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe6aabcc-a1cf-40c5-95ae-c840e3c3b337 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:16.624341 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe6aabcc-a1cf-40c5-95ae-c840e3c3b337 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:16.764490 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe6aabcc-a1cf-40c5-95ae-c840e3c3b337 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:16.774994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fe6aabcc-a1cf-40c5-95ae-c840e3c3b337 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.164385 Jun 04 18:32:16.775566 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 210/401] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:16 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:17.796917 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fd699e03-0152-4eb0-a7cb-cb0b3ee5fa20 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:17.797555 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fd699e03-0152-4eb0-a7cb-cb0b3ee5fa20 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:17.804645 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd699e03-0152-4eb0-a7cb-cb0b3ee5fa20 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:17.805095 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd699e03-0152-4eb0-a7cb-cb0b3ee5fa20 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:17.806237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd699e03-0152-4eb0-a7cb-cb0b3ee5fa20 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:17.806768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd699e03-0152-4eb0-a7cb-cb0b3ee5fa20 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:18.046366 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fd699e03-0152-4eb0-a7cb-cb0b3ee5fa20 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:18.055102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fd699e03-0152-4eb0-a7cb-cb0b3ee5fa20 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.262314 Jun 04 18:32:18.055596 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 192/402] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:17 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:18.207998 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-c0a33417-92e7-455b-b5a4-0e1e4c848db2 req-368cd931-5444-450b-8367-3e2a677f3d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e974c3d-7f67-46b4-91cf-27b8c2db1b13", "tag": "6dd02dd3-7f7a-45a5-b6b6-da67814319b2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:18.218780 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c0a33417-92e7-455b-b5a4-0e1e4c848db2 req-368cd931-5444-450b-8367-3e2a677f3d6a service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:18.219294 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c0a33417-92e7-455b-b5a4-0e1e4c848db2 req-368cd931-5444-450b-8367-3e2a677f3d6a service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:18.231518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-c0a33417-92e7-455b-b5a4-0e1e4c848db2 req-368cd931-5444-450b-8367-3e2a677f3d6a service nova] Creating event network-changed:6dd02dd3-7f7a-45a5-b6b6-da67814319b2 for instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 on hv-cinder-79053 Jun 04 18:32:18.236468 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-c0a33417-92e7-455b-b5a4-0e1e4c848db2 req-368cd931-5444-450b-8367-3e2a677f3d6a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032245 Jun 04 18:32:18.237116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 211/403] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:32:18.956110 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-37aca5c1-e31b-4e92-a8a1-59f2c1e4a449 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1864312-f78e-44ac-9201-21f9b8457229", "device": "/dev/sdb"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:18.957734 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-37aca5c1-e31b-4e92-a8a1-59f2c1e4a449 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:18.964551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37aca5c1-e31b-4e92-a8a1-59f2c1e4a449 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:18.964994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37aca5c1-e31b-4e92-a8a1-59f2c1e4a449 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:18.965746 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37aca5c1-e31b-4e92-a8a1-59f2c1e4a449 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:18.966179 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37aca5c1-e31b-4e92-a8a1-59f2c1e4a449 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:19.074296 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-15e5aa32-6d3e-49b1-9d2c-6aa2068f77c0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:19.074991 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-15e5aa32-6d3e-49b1-9d2c-6aa2068f77c0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:19.081565 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-15e5aa32-6d3e-49b1-9d2c-6aa2068f77c0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:19.082017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-15e5aa32-6d3e-49b1-9d2c-6aa2068f77c0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:19.082780 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-15e5aa32-6d3e-49b1-9d2c-6aa2068f77c0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:19.083216 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-15e5aa32-6d3e-49b1-9d2c-6aa2068f77c0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:19.228260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-15e5aa32-6d3e-49b1-9d2c-6aa2068f77c0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:19.235872 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-15e5aa32-6d3e-49b1-9d2c-6aa2068f77c0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.167184 Jun 04 18:32:19.236435 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 212/404] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:19 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:20.257162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a46f63eb-9212-42f6-a810-fa1a5f933af8 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:20.258560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a46f63eb-9212-42f6-a810-fa1a5f933af8 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:20.268656 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a46f63eb-9212-42f6-a810-fa1a5f933af8 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:20.269405 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a46f63eb-9212-42f6-a810-fa1a5f933af8 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:20.270682 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a46f63eb-9212-42f6-a810-fa1a5f933af8 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:20.271414 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a46f63eb-9212-42f6-a810-fa1a5f933af8 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:20.409321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a46f63eb-9212-42f6-a810-fa1a5f933af8 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:20.417695 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a46f63eb-9212-42f6-a810-fa1a5f933af8 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.167051 Jun 04 18:32:20.418521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 213/405] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:20 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:21.435179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5137e76a-071d-481c-8c3e-e2512b3e24de tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:21.435864 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5137e76a-071d-481c-8c3e-e2512b3e24de tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:21.442264 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5137e76a-071d-481c-8c3e-e2512b3e24de tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:21.442707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5137e76a-071d-481c-8c3e-e2512b3e24de tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:21.443498 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5137e76a-071d-481c-8c3e-e2512b3e24de tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:21.443904 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5137e76a-071d-481c-8c3e-e2512b3e24de tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:21.576416 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5137e76a-071d-481c-8c3e-e2512b3e24de tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:21.584395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5137e76a-071d-481c-8c3e-e2512b3e24de tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.153173 Jun 04 18:32:21.584980 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 214/406] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:21 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:21.872123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-37aca5c1-e31b-4e92-a8a1-59f2c1e4a449 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "POST /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.920027 Jun 04 18:32:21.875971 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 193/407] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:32:18 2022] POST /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635/os-volume_attachments => generated 194 bytes in 2922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:32:22.606599 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c307c48f-b87d-4ede-bbea-3930e554d40b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:22.607233 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c307c48f-b87d-4ede-bbea-3930e554d40b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:22.614908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c307c48f-b87d-4ede-bbea-3930e554d40b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:22.615434 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c307c48f-b87d-4ede-bbea-3930e554d40b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:22.616367 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c307c48f-b87d-4ede-bbea-3930e554d40b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:22.616876 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c307c48f-b87d-4ede-bbea-3930e554d40b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:22.752528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c307c48f-b87d-4ede-bbea-3930e554d40b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:22.764394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c307c48f-b87d-4ede-bbea-3930e554d40b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.164554 Jun 04 18:32:22.764959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 215/408] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:22 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:23.562399 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-af000aa8-dafe-4438-a344-ae6f7181085c req-4ffecf4c-a076-4328-b300-c2281593ce0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e974c3d-7f67-46b4-91cf-27b8c2db1b13", "name": "network-vif-plugged", "status": "completed", "tag": "6dd02dd3-7f7a-45a5-b6b6-da67814319b2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:23.565956 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:23.571872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-af000aa8-dafe-4438-a344-ae6f7181085c req-4ffecf4c-a076-4328-b300-c2281593ce0b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:23.572343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-af000aa8-dafe-4438-a344-ae6f7181085c req-4ffecf4c-a076-4328-b300-c2281593ce0b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:23.575308 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:23.585568 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-af000aa8-dafe-4438-a344-ae6f7181085c req-4ffecf4c-a076-4328-b300-c2281593ce0b service nova] Creating event network-vif-plugged:6dd02dd3-7f7a-45a5-b6b6-da67814319b2 for instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 on hv-cinder-79053 Jun 04 18:32:23.590817 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-af000aa8-dafe-4438-a344-ae6f7181085c req-4ffecf4c-a076-4328-b300-c2281593ce0b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033433 Jun 04 18:32:23.591506 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 194/409] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:32:23.782394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dca973fd-14bc-4974-b839-7d4980aa764d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:23.782998 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dca973fd-14bc-4974-b839-7d4980aa764d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:23.789548 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dca973fd-14bc-4974-b839-7d4980aa764d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:23.789992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dca973fd-14bc-4974-b839-7d4980aa764d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:23.790748 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dca973fd-14bc-4974-b839-7d4980aa764d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:23.791176 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dca973fd-14bc-4974-b839-7d4980aa764d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:23.929471 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dca973fd-14bc-4974-b839-7d4980aa764d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:23.937445 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dca973fd-14bc-4974-b839-7d4980aa764d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.159414 Jun 04 18:32:23.938001 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 216/410] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:23 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:24.965703 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c509a57d-1a18-4028-9ddf-5cd2feaeb58c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:24.966993 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c509a57d-1a18-4028-9ddf-5cd2feaeb58c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:24.978135 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c509a57d-1a18-4028-9ddf-5cd2feaeb58c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:24.978897 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c509a57d-1a18-4028-9ddf-5cd2feaeb58c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:24.980219 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c509a57d-1a18-4028-9ddf-5cd2feaeb58c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:24.980942 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c509a57d-1a18-4028-9ddf-5cd2feaeb58c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:25.129566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c509a57d-1a18-4028-9ddf-5cd2feaeb58c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:25.137354 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c509a57d-1a18-4028-9ddf-5cd2feaeb58c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1357 microversion: 2.1 time: 0.180126 Jun 04 18:32:25.137944 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 195/411] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:24 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:26.156896 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7fb59def-4032-4738-9b54-796507c1146e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:26.157500 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7fb59def-4032-4738-9b54-796507c1146e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:26.159658 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:26.165731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fb59def-4032-4738-9b54-796507c1146e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.165891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fb59def-4032-4738-9b54-796507c1146e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.166711 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fb59def-4032-4738-9b54-796507c1146e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.167147 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fb59def-4032-4738-9b54-796507c1146e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.298664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7fb59def-4032-4738-9b54-796507c1146e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:26.306674 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7fb59def-4032-4738-9b54-796507c1146e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1547 microversion: 2.1 time: 0.154664 Jun 04 18:32:26.307234 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 217/412] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:26 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:26.329167 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-eadf4105-5c06-465c-85f7-94d154c88e59 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:26.329781 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-eadf4105-5c06-465c-85f7-94d154c88e59 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:26.336682 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eadf4105-5c06-465c-85f7-94d154c88e59 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.337134 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eadf4105-5c06-465c-85f7-94d154c88e59 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.337899 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eadf4105-5c06-465c-85f7-94d154c88e59 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.338345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eadf4105-5c06-465c-85f7-94d154c88e59 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.469608 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-eadf4105-5c06-465c-85f7-94d154c88e59 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:26.477331 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-eadf4105-5c06-465c-85f7-94d154c88e59 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1547 microversion: 2.1 time: 0.152176 Jun 04 18:32:26.477869 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 196/413] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:26 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:26.493310 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d3785712-15a4-4363-8963-be13c32329bd tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:26.496737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d3785712-15a4-4363-8963-be13c32329bd tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:26.497524 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d3785712-15a4-4363-8963-be13c32329bd tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Searching by: {'deleted': False, 'project_id': '5cfb3750227e4037b6e92552361366f4'} {{(pid=117732) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 18:32:26.505056 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3785712-15a4-4363-8963-be13c32329bd tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.505530 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3785712-15a4-4363-8963-be13c32329bd tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.506353 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3785712-15a4-4363-8963-be13c32329bd tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.506761 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3785712-15a4-4363-8963-be13c32329bd tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.599533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.multi_cell_list [None req-d3785712-15a4-4363-8963-be13c32329bd tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 18:32:26.695039 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d3785712-15a4-4363-8963-be13c32329bd tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205468 Jun 04 18:32:26.695616 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 218/414] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 4 18:32:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:32:26.709080 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8d35bd94-7001-454b-a88a-9019d0894d6b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:26.710028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8d35bd94-7001-454b-a88a-9019d0894d6b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:26.718069 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d35bd94-7001-454b-a88a-9019d0894d6b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.718519 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d35bd94-7001-454b-a88a-9019d0894d6b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.719285 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d35bd94-7001-454b-a88a-9019d0894d6b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.719717 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d35bd94-7001-454b-a88a-9019d0894d6b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.768825 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-56884c38-9370-46d1-a788-b6d6a1b896cf tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:26.769469 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-56884c38-9370-46d1-a788-b6d6a1b896cf tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:26.778403 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-56884c38-9370-46d1-a788-b6d6a1b896cf tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.778955 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-56884c38-9370-46d1-a788-b6d6a1b896cf tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.779767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-56884c38-9370-46d1-a788-b6d6a1b896cf tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:26.780243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-56884c38-9370-46d1-a788-b6d6a1b896cf tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:26.804395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-56884c38-9370-46d1-a788-b6d6a1b896cf tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/ips" status: 200 len: 145 microversion: 2.1 time: 0.039929 Jun 04 18:32:26.804978 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 219/415] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:32:26 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:32:26.859389 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8d35bd94-7001-454b-a88a-9019d0894d6b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:26.867743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8d35bd94-7001-454b-a88a-9019d0894d6b tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1547 microversion: 2.1 time: 0.165063 Jun 04 18:32:26.868348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 197/416] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:26 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:28.426321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e384ea84-7068-4cac-b815-f0d0a3d6d690 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "295f027e-4cb6-4aff-81a8-97ef70afd102"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:28.427394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e384ea84-7068-4cac-b815-f0d0a3d6d690 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:28.433935 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e384ea84-7068-4cac-b815-f0d0a3d6d690 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:28.434387 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e384ea84-7068-4cac-b815-f0d0a3d6d690 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:28.435190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e384ea84-7068-4cac-b815-f0d0a3d6d690 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:28.435628 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e384ea84-7068-4cac-b815-f0d0a3d6d690 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:28.712946 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e384ea84-7068-4cac-b815-f0d0a3d6d690 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "POST /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290466 Jun 04 18:32:28.713821 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 220/417] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:32:28 2022] POST /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:32:28.891926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3765989d-18f1-431e-bfe1-c30e5b8ff4bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a702bf7b-9628-448c-9af7-7d6c35a8ecae"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:28.893021 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3765989d-18f1-431e-bfe1-c30e5b8ff4bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:28.899546 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3765989d-18f1-431e-bfe1-c30e5b8ff4bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:28.899994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3765989d-18f1-431e-bfe1-c30e5b8ff4bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:28.900791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3765989d-18f1-431e-bfe1-c30e5b8ff4bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:28.901225 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3765989d-18f1-431e-bfe1-c30e5b8ff4bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:29.170774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3765989d-18f1-431e-bfe1-c30e5b8ff4bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282619 Jun 04 18:32:29.172260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 198/418] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:32:28 2022] POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:32:40.568760 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:40.569605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=7 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:40.570247 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:40.574865 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5a336a18-8490-4f52-894d-569d85528b89 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:40.575669 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5a336a18-8490-4f52-894d-569d85528b89 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:40.584292 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5a336a18-8490-4f52-894d-569d85528b89 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:40.584745 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5a336a18-8490-4f52-894d-569d85528b89 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:40.585518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5a336a18-8490-4f52-894d-569d85528b89 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:40.585949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5a336a18-8490-4f52-894d-569d85528b89 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:40.733381 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5a336a18-8490-4f52-894d-569d85528b89 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:40.742103 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5a336a18-8490-4f52-894d-569d85528b89 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1593 microversion: 2.1 time: 0.174986 Jun 04 18:32:40.742695 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 221/419] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:40 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1593 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:42.583014 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=9 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:42.583887 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:42.588374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-972ded7b-8d0d-4c39-b6ab-442e0b58d524 req-1c9ca164-1269-44b7-a245-44be617dcdcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e974c3d-7f67-46b4-91cf-27b8c2db1b13", "tag": "6dd02dd3-7f7a-45a5-b6b6-da67814319b2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:42.598713 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-972ded7b-8d0d-4c39-b6ab-442e0b58d524 req-1c9ca164-1269-44b7-a245-44be617dcdcd service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:42.599161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-972ded7b-8d0d-4c39-b6ab-442e0b58d524 req-1c9ca164-1269-44b7-a245-44be617dcdcd service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:42.613217 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-972ded7b-8d0d-4c39-b6ab-442e0b58d524 req-1c9ca164-1269-44b7-a245-44be617dcdcd service nova] Creating event network-changed:6dd02dd3-7f7a-45a5-b6b6-da67814319b2 for instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 on hv-cinder-79053 Jun 04 18:32:42.618853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-972ded7b-8d0d-4c39-b6ab-442e0b58d524 req-1c9ca164-1269-44b7-a245-44be617dcdcd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037540 Jun 04 18:32:42.620492 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 199/420] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:32:43.546365 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d15725a5-38f9-44ba-a606-390732652191 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1289180485"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:43.546923 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d15725a5-38f9-44ba-a606-390732652191 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:43.554450 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d15725a5-38f9-44ba-a606-390732652191 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:43.554450 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d15725a5-38f9-44ba-a606-390732652191 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:43.555445 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d15725a5-38f9-44ba-a606-390732652191 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:43.555619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d15725a5-38f9-44ba-a606-390732652191 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:43.689519 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.network.security_group_api [None req-d15725a5-38f9-44ba-a606-390732652191 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Adding security group 37e62876-6b69-4ac5-ad15-7717b62d5194 to port 6dd02dd3-7f7a-45a5-b6b6-da67814319b2 Jun 04 18:32:44.090020 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d15725a5-38f9-44ba-a606-390732652191 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "POST /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/action" status: 202 len: 0 microversion: 2.1 time: 0.547596 Jun 04 18:32:44.090631 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 222/421] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:32:43 2022] POST /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:32:44.099632 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-869ec502-2424-4b31-bd4d-51083d0cb6eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:44.100267 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-869ec502-2424-4b31-bd4d-51083d0cb6eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:44.101878 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-33015c10-cfe5-48b0-bd1b-264f6c00e1f6 req-c4c1467c-4aa6-4595-b26f-2628a1eaac52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e974c3d-7f67-46b4-91cf-27b8c2db1b13", "tag": "6dd02dd3-7f7a-45a5-b6b6-da67814319b2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:44.106515 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-869ec502-2424-4b31-bd4d-51083d0cb6eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:44.106958 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-869ec502-2424-4b31-bd4d-51083d0cb6eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:44.107717 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-869ec502-2424-4b31-bd4d-51083d0cb6eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:44.108346 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-869ec502-2424-4b31-bd4d-51083d0cb6eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:44.118430 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-33015c10-cfe5-48b0-bd1b-264f6c00e1f6 req-c4c1467c-4aa6-4595-b26f-2628a1eaac52 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:44.119111 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-33015c10-cfe5-48b0-bd1b-264f6c00e1f6 req-c4c1467c-4aa6-4595-b26f-2628a1eaac52 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:44.132425 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-33015c10-cfe5-48b0-bd1b-264f6c00e1f6 req-c4c1467c-4aa6-4595-b26f-2628a1eaac52 service nova] Creating event network-changed:6dd02dd3-7f7a-45a5-b6b6-da67814319b2 for instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 on hv-cinder-79053 Jun 04 18:32:44.138133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-33015c10-cfe5-48b0-bd1b-264f6c00e1f6 req-c4c1467c-4aa6-4595-b26f-2628a1eaac52 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042897 Jun 04 18:32:44.138839 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 200/422] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:32:44.271390 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-869ec502-2424-4b31-bd4d-51083d0cb6eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:44.279554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-869ec502-2424-4b31-bd4d-51083d0cb6eb tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1640 microversion: 2.1 time: 0.184868 Jun 04 18:32:44.280126 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 223/423] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:44 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1640 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:32:48.376029 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-16eb8532-f0c4-4c8c-9483-b2ac27334fda tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:48.382312 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16eb8532-f0c4-4c8c-9483-b2ac27334fda tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:48.382865 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16eb8532-f0c4-4c8c-9483-b2ac27334fda tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:48.442470 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-16eb8532-f0c4-4c8c-9483-b2ac27334fda tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Going to try to stop instance {{(pid=117731) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 18:32:48.489021 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-16eb8532-f0c4-4c8c-9483-b2ac27334fda tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/action" status: 202 len: 0 microversion: 2.1 time: 0.117714 Jun 04 18:32:48.489622 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 201/424] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:32:48 2022] POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 18:32:48.498261 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2680e356-6f7c-448b-a99e-0bd813041b27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:48.498876 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2680e356-6f7c-448b-a99e-0bd813041b27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:48.505716 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2680e356-6f7c-448b-a99e-0bd813041b27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:48.506440 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2680e356-6f7c-448b-a99e-0bd813041b27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:48.507217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2680e356-6f7c-448b-a99e-0bd813041b27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:48.507882 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2680e356-6f7c-448b-a99e-0bd813041b27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:48.642674 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2680e356-6f7c-448b-a99e-0bd813041b27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:48.651518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2680e356-6f7c-448b-a99e-0bd813041b27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.157230 Jun 04 18:32:48.652119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 224/425] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:48 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:49.675295 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-446c2674-9d30-42c3-9622-a84b02ccebaa tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:49.676458 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-446c2674-9d30-42c3-9622-a84b02ccebaa tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:49.684489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-446c2674-9d30-42c3-9622-a84b02ccebaa tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:49.684943 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-446c2674-9d30-42c3-9622-a84b02ccebaa tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:49.685704 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-446c2674-9d30-42c3-9622-a84b02ccebaa tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:49.686146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-446c2674-9d30-42c3-9622-a84b02ccebaa tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:49.823583 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-446c2674-9d30-42c3-9622-a84b02ccebaa tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:49.831738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-446c2674-9d30-42c3-9622-a84b02ccebaa tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.164468 Jun 04 18:32:49.832339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 202/426] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:49 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:50.854560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-37cfcdea-21e6-4d1d-b7df-b9774ee644a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:50.855490 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-37cfcdea-21e6-4d1d-b7df-b9774ee644a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:50.866971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-37cfcdea-21e6-4d1d-b7df-b9774ee644a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:50.867786 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-37cfcdea-21e6-4d1d-b7df-b9774ee644a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:50.868618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-37cfcdea-21e6-4d1d-b7df-b9774ee644a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:50.869054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-37cfcdea-21e6-4d1d-b7df-b9774ee644a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:50.904653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-becfd2cf-ab30-4045-bee9-f22eb39b6fdf tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:50.905271 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-becfd2cf-ab30-4045-bee9-f22eb39b6fdf tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:50.911931 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-becfd2cf-ab30-4045-bee9-f22eb39b6fdf tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:50.912766 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-becfd2cf-ab30-4045-bee9-f22eb39b6fdf tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:50.913586 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-becfd2cf-ab30-4045-bee9-f22eb39b6fdf tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:50.914300 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-becfd2cf-ab30-4045-bee9-f22eb39b6fdf tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:51.010386 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-37cfcdea-21e6-4d1d-b7df-b9774ee644a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:51.019144 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-37cfcdea-21e6-4d1d-b7df-b9774ee644a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.171726 Jun 04 18:32:51.019712 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 225/427] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:50 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:51.046420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-becfd2cf-ab30-4045-bee9-f22eb39b6fdf tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lazy-loading 'services' on Instance uuid 91304396-821c-4f27-9299-359438ac6635 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:32:51.167459 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-becfd2cf-ab30-4045-bee9-f22eb39b6fdf tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "DELETE /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635/os-volume_attachments/c1864312-f78e-44ac-9201-21f9b8457229" status: 202 len: 0 microversion: 2.1 time: 0.266631 Jun 04 18:32:51.168426 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 203/428] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:32:50 2022] DELETE /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635/os-volume_attachments/c1864312-f78e-44ac-9201-21f9b8457229 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:32:52.040494 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-830c45cf-f042-482d-ab4a-900f53be4f4f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:52.041423 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-830c45cf-f042-482d-ab4a-900f53be4f4f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:52.049660 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-830c45cf-f042-482d-ab4a-900f53be4f4f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:52.050116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-830c45cf-f042-482d-ab4a-900f53be4f4f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:52.050886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-830c45cf-f042-482d-ab4a-900f53be4f4f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:52.051340 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-830c45cf-f042-482d-ab4a-900f53be4f4f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:52.196398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-830c45cf-f042-482d-ab4a-900f53be4f4f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:52.205168 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-830c45cf-f042-482d-ab4a-900f53be4f4f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.171219 Jun 04 18:32:52.205743 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 226/429] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:52 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:52.281436 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ba8421ce-689d-4a5f-8a2e-2d4971de3054 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:52.281998 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ba8421ce-689d-4a5f-8a2e-2d4971de3054 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:52.289604 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba8421ce-689d-4a5f-8a2e-2d4971de3054 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:52.290043 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba8421ce-689d-4a5f-8a2e-2d4971de3054 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:52.290869 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba8421ce-689d-4a5f-8a2e-2d4971de3054 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:52.291222 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba8421ce-689d-4a5f-8a2e-2d4971de3054 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:52.317026 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ba8421ce-689d-4a5f-8a2e-2d4971de3054 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:32:52.409139 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ba8421ce-689d-4a5f-8a2e-2d4971de3054 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "DELETE /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 204 len: 0 microversion: 2.1 time: 0.131960 Jun 04 18:32:52.410003 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 204/430] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:32:52 2022] DELETE /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:32:52.418303 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fa4d42a5-dd98-4a90-ad50-a008a0c4ed76 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:52.418909 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fa4d42a5-dd98-4a90-ad50-a008a0c4ed76 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:52.425196 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa4d42a5-dd98-4a90-ad50-a008a0c4ed76 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:52.425640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa4d42a5-dd98-4a90-ad50-a008a0c4ed76 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:52.426392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa4d42a5-dd98-4a90-ad50-a008a0c4ed76 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:52.426818 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa4d42a5-dd98-4a90-ad50-a008a0c4ed76 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:52.572427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fa4d42a5-dd98-4a90-ad50-a008a0c4ed76 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:52.581685 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fa4d42a5-dd98-4a90-ad50-a008a0c4ed76 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1514 microversion: 2.1 time: 0.167220 Jun 04 18:32:52.582265 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 227/431] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:52 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:53.223543 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9769a0b6-286d-4fd1-9741-7eb6a65b3960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:53.224291 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9769a0b6-286d-4fd1-9741-7eb6a65b3960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:53.231452 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9769a0b6-286d-4fd1-9741-7eb6a65b3960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:53.232227 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9769a0b6-286d-4fd1-9741-7eb6a65b3960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:53.232822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9769a0b6-286d-4fd1-9741-7eb6a65b3960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:53.233253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9769a0b6-286d-4fd1-9741-7eb6a65b3960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:53.382270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9769a0b6-286d-4fd1-9741-7eb6a65b3960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:53.390855 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9769a0b6-286d-4fd1-9741-7eb6a65b3960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.171808 Jun 04 18:32:53.391428 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 205/432] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:53 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:53.603133 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b9e5ddee-4d70-4ded-9f1d-3e77b70660d9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:53.603970 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b9e5ddee-4d70-4ded-9f1d-3e77b70660d9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:53.615388 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9e5ddee-4d70-4ded-9f1d-3e77b70660d9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:53.616193 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9e5ddee-4d70-4ded-9f1d-3e77b70660d9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:53.617452 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9e5ddee-4d70-4ded-9f1d-3e77b70660d9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:53.618127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9e5ddee-4d70-4ded-9f1d-3e77b70660d9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:53.757458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b9e5ddee-4d70-4ded-9f1d-3e77b70660d9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:53.765738 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b9e5ddee-4d70-4ded-9f1d-3e77b70660d9 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1514 microversion: 2.1 time: 0.169424 Jun 04 18:32:53.766288 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 228/433] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:53 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:54.408809 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1ca3b7fc-cab7-4a7e-9274-5e4662c1aff8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:54.409417 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1ca3b7fc-cab7-4a7e-9274-5e4662c1aff8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:54.416998 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1ca3b7fc-cab7-4a7e-9274-5e4662c1aff8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:54.417445 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1ca3b7fc-cab7-4a7e-9274-5e4662c1aff8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:54.418232 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1ca3b7fc-cab7-4a7e-9274-5e4662c1aff8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:54.418664 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1ca3b7fc-cab7-4a7e-9274-5e4662c1aff8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:54.574922 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1ca3b7fc-cab7-4a7e-9274-5e4662c1aff8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:54.585623 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1ca3b7fc-cab7-4a7e-9274-5e4662c1aff8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.181105 Jun 04 18:32:54.586214 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 206/434] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:54 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:54.783181 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a5138b33-74cf-4bbb-96b0-e83f71f1ca6f tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:54.783879 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a5138b33-74cf-4bbb-96b0-e83f71f1ca6f tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:54.791487 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5138b33-74cf-4bbb-96b0-e83f71f1ca6f tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:54.792024 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5138b33-74cf-4bbb-96b0-e83f71f1ca6f tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:54.792783 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5138b33-74cf-4bbb-96b0-e83f71f1ca6f tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:54.793235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5138b33-74cf-4bbb-96b0-e83f71f1ca6f tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:54.927875 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a5138b33-74cf-4bbb-96b0-e83f71f1ca6f tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:54.935796 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a5138b33-74cf-4bbb-96b0-e83f71f1ca6f tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 200 len: 1514 microversion: 2.1 time: 0.156748 Jun 04 18:32:54.936619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 229/435] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:54 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:55.033085 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-b169d26e-c166-44c3-bfc7-b3156d7da72a req-3620b87f-baa9-4b8d-8db9-ac73d88abdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91304396-821c-4f27-9299-359438ac6635", "name": "network-vif-deleted", "tag": "1c409352-245f-49d5-b9f1-78883d391677"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:32:55.042039 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b169d26e-c166-44c3-bfc7-b3156d7da72a req-3620b87f-baa9-4b8d-8db9-ac73d88abdb8 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:55.042489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b169d26e-c166-44c3-bfc7-b3156d7da72a req-3620b87f-baa9-4b8d-8db9-ac73d88abdb8 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:55.054615 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-b169d26e-c166-44c3-bfc7-b3156d7da72a req-3620b87f-baa9-4b8d-8db9-ac73d88abdb8 service nova] Creating event network-vif-deleted:1c409352-245f-49d5-b9f1-78883d391677 for instance 91304396-821c-4f27-9299-359438ac6635 on hv-cinder-79053 Jun 04 18:32:55.059708 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-b169d26e-c166-44c3-bfc7-b3156d7da72a req-3620b87f-baa9-4b8d-8db9-ac73d88abdb8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030331 Jun 04 18:32:55.060412 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 207/436] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:32:55.603074 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ccec13f3-292d-4aed-a5fe-d3bd3f061960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:55.603613 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ccec13f3-292d-4aed-a5fe-d3bd3f061960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:55.610946 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ccec13f3-292d-4aed-a5fe-d3bd3f061960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:55.611398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ccec13f3-292d-4aed-a5fe-d3bd3f061960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:55.612236 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ccec13f3-292d-4aed-a5fe-d3bd3f061960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:55.612801 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ccec13f3-292d-4aed-a5fe-d3bd3f061960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:55.745530 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ccec13f3-292d-4aed-a5fe-d3bd3f061960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:55.756059 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ccec13f3-292d-4aed-a5fe-d3bd3f061960 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.156735 Jun 04 18:32:55.756651 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 230/437] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:55 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:55.954872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:55.955560 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 91304396-821c-4f27-9299-359438ac6635] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:55.962880 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:55.963330 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:55.964120 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:55.964556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:55.981352 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] HTTP exception thrown: Instance 91304396-821c-4f27-9299-359438ac6635 could not be found. Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Request method failure captured: Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 HTTP/1.1 Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6T2TjU29qvntah1GLxOLQjOSIpaqMOG_rfBNJ9gxdzzeRzomtybV5pdIrNdxoDN6rA47jBw1oPwu1nfl4-SkWicXVO6L3r6Th-9R8-sGrToHPoQej8YwOeHZOWIH5aN449wGqb10EiRmxvXlAXkrLEY3MrYTmhHbQSxh2T5IjSyafo Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: b6ed2dc911c44ea0953b7c849e590a8a Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1307654825 Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:32:55.982975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6ed2dc911c44ea0953b7c849e590a8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b6ed2dc911c44ea0953b7c849e590a8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b6ed2dc911c44ea0953b7c849e590a8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6ed2dc911c44ea0953b7c849e590a8a"}]}] Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesSnapshotTestJSON-1307654825 Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b6ed2dc911c44ea0953b7c849e590a8a Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1307654825 Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesSnapshotTestJSON-1307654825-project Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: d193c0fa3d934ba99e8929b2e2ab65c3 Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesSnapshotTestJSON-1307654825-project Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 91304396-821c-4f27-9299-359438ac6635 could not be found. Jun 04 18:32:55.985028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '91304396-821c-4f27-9299-359438ac6635'} Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91304396-821c-4f27-9299-359438ac6635 could not be found. Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:32:55.986040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91304396-821c-4f27-9299-359438ac6635 could not be found. Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91304396-821c-4f27-9299-359438ac6635 could not be found. Jun 04 18:32:55.987611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:32:55.989172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Returning 404 to user: Instance 91304396-821c-4f27-9299-359438ac6635 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:32:55.989172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c2c82947-5fd0-4047-a621-648c075271e1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635" status: 404 len: 111 microversion: 2.1 time: 0.034347 Jun 04 18:32:55.989172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 208/438] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:55 2022] GET /compute/v2.1/servers/91304396-821c-4f27-9299-359438ac6635 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:32:56.777699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1e388164-63ec-409c-b090-bd89f30a4ded tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:56.778649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1e388164-63ec-409c-b090-bd89f30a4ded tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:56.786697 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1e388164-63ec-409c-b090-bd89f30a4ded tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:56.787502 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1e388164-63ec-409c-b090-bd89f30a4ded tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:56.788302 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1e388164-63ec-409c-b090-bd89f30a4ded tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:56.788739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1e388164-63ec-409c-b090-bd89f30a4ded tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:56.933727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1e388164-63ec-409c-b090-bd89f30a4ded tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:56.942377 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1e388164-63ec-409c-b090-bd89f30a4ded tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.171208 Jun 04 18:32:56.942951 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 231/439] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:56 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:57.965119 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-abff9c28-4168-4555-9422-569d90d8cd9d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:57.966077 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-abff9c28-4168-4555-9422-569d90d8cd9d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:57.977510 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abff9c28-4168-4555-9422-569d90d8cd9d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:57.978248 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abff9c28-4168-4555-9422-569d90d8cd9d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:57.979567 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abff9c28-4168-4555-9422-569d90d8cd9d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:57.980295 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abff9c28-4168-4555-9422-569d90d8cd9d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:58.120974 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-abff9c28-4168-4555-9422-569d90d8cd9d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:58.129319 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-abff9c28-4168-4555-9422-569d90d8cd9d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.170773 Jun 04 18:32:58.129885 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 209/440] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:57 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:32:59.149380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-61836e30-59d7-4939-9be1-4624b3f70db0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:32:59.150375 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-61836e30-59d7-4939-9be1-4624b3f70db0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:32:59.159880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-61836e30-59d7-4939-9be1-4624b3f70db0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:59.160571 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-61836e30-59d7-4939-9be1-4624b3f70db0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:59.161653 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-61836e30-59d7-4939-9be1-4624b3f70db0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:32:59.162642 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-61836e30-59d7-4939-9be1-4624b3f70db0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:32:59.301610 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-61836e30-59d7-4939-9be1-4624b3f70db0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:32:59.309829 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-61836e30-59d7-4939-9be1-4624b3f70db0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.166556 Jun 04 18:32:59.310392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 232/441] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:32:59 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:00.327061 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b08d3e40-afda-490a-9c51-f28680f92905 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:00.327701 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b08d3e40-afda-490a-9c51-f28680f92905 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:00.335113 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b08d3e40-afda-490a-9c51-f28680f92905 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:00.335573 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b08d3e40-afda-490a-9c51-f28680f92905 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:00.336606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b08d3e40-afda-490a-9c51-f28680f92905 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:00.337043 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b08d3e40-afda-490a-9c51-f28680f92905 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:00.484659 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b08d3e40-afda-490a-9c51-f28680f92905 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:00.493001 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b08d3e40-afda-490a-9c51-f28680f92905 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.169910 Jun 04 18:33:00.493563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 210/442] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:00 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:01.511518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2d10ec3a-1733-44ac-bedf-86300dd4d39e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:01.512162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2d10ec3a-1733-44ac-bedf-86300dd4d39e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:01.518550 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2d10ec3a-1733-44ac-bedf-86300dd4d39e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:01.518993 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2d10ec3a-1733-44ac-bedf-86300dd4d39e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:01.519748 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2d10ec3a-1733-44ac-bedf-86300dd4d39e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:01.520219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2d10ec3a-1733-44ac-bedf-86300dd4d39e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:01.656815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2d10ec3a-1733-44ac-bedf-86300dd4d39e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:01.670084 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2d10ec3a-1733-44ac-bedf-86300dd4d39e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.163440 Jun 04 18:33:01.670902 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 233/443] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:01 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:02.688182 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-07edaa35-aa7e-4af5-9c5c-8be14d111612 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:02.688743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-07edaa35-aa7e-4af5-9c5c-8be14d111612 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:02.695629 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-07edaa35-aa7e-4af5-9c5c-8be14d111612 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:02.696199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-07edaa35-aa7e-4af5-9c5c-8be14d111612 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:02.697020 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-07edaa35-aa7e-4af5-9c5c-8be14d111612 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:02.697455 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-07edaa35-aa7e-4af5-9c5c-8be14d111612 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:02.835912 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-07edaa35-aa7e-4af5-9c5c-8be14d111612 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:02.844288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-07edaa35-aa7e-4af5-9c5c-8be14d111612 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.160220 Jun 04 18:33:02.844851 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 211/444] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:02 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:33:03.865935 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-eebd8584-5725-4e99-99ef-b815a068f681 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:03.866928 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-eebd8584-5725-4e99-99ef-b815a068f681 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:03.878178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eebd8584-5725-4e99-99ef-b815a068f681 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:03.878916 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eebd8584-5725-4e99-99ef-b815a068f681 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:03.880212 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eebd8584-5725-4e99-99ef-b815a068f681 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:03.880929 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eebd8584-5725-4e99-99ef-b815a068f681 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:04.036135 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eebd8584-5725-4e99-99ef-b815a068f681 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:04.048810 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-eebd8584-5725-4e99-99ef-b815a068f681 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.189513 Jun 04 18:33:04.049501 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 234/445] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:03 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:05.067911 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b0b32122-d6eb-4c6a-b946-4a6bf4cd556c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:05.068705 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b0b32122-d6eb-4c6a-b946-4a6bf4cd556c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:05.075777 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b0b32122-d6eb-4c6a-b946-4a6bf4cd556c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:05.076257 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b0b32122-d6eb-4c6a-b946-4a6bf4cd556c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:05.077025 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b0b32122-d6eb-4c6a-b946-4a6bf4cd556c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:05.077460 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b0b32122-d6eb-4c6a-b946-4a6bf4cd556c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:05.228430 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b0b32122-d6eb-4c6a-b946-4a6bf4cd556c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:05.237113 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b0b32122-d6eb-4c6a-b946-4a6bf4cd556c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.173285 Jun 04 18:33:05.237694 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 212/446] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:05 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:06.259216 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dab2a1db-898e-4ef7-af97-98a1b39ef32f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:06.260267 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dab2a1db-898e-4ef7-af97-98a1b39ef32f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:06.271357 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dab2a1db-898e-4ef7-af97-98a1b39ef32f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:06.272093 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dab2a1db-898e-4ef7-af97-98a1b39ef32f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:06.273385 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dab2a1db-898e-4ef7-af97-98a1b39ef32f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:06.274101 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dab2a1db-898e-4ef7-af97-98a1b39ef32f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:06.414274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dab2a1db-898e-4ef7-af97-98a1b39ef32f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:06.427061 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dab2a1db-898e-4ef7-af97-98a1b39ef32f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1722 microversion: 2.1 time: 0.174072 Jun 04 18:33:06.427826 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 235/447] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:06 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:07.445372 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cbece51f-6710-4bf8-8a4b-50976363e9dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:07.445965 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cbece51f-6710-4bf8-8a4b-50976363e9dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:07.453273 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbece51f-6710-4bf8-8a4b-50976363e9dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:07.453745 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbece51f-6710-4bf8-8a4b-50976363e9dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:07.454505 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbece51f-6710-4bf8-8a4b-50976363e9dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:07.454967 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbece51f-6710-4bf8-8a4b-50976363e9dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:07.593274 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cbece51f-6710-4bf8-8a4b-50976363e9dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:07.601724 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cbece51f-6710-4bf8-8a4b-50976363e9dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1699 microversion: 2.1 time: 0.160326 Jun 04 18:33:07.602289 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 213/448] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:07 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:07.618381 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9b009bc9-9578-4707-97ad-fe19b3cb71dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:07.625911 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b009bc9-9578-4707-97ad-fe19b3cb71dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:07.626385 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b009bc9-9578-4707-97ad-fe19b3cb71dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:07.686969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9b009bc9-9578-4707-97ad-fe19b3cb71dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Going to try to start instance {{(pid=117732) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 18:33:07.735273 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:07.748097 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9b009bc9-9578-4707-97ad-fe19b3cb71dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/action" status: 202 len: 0 microversion: 2.1 time: 0.133433 Jun 04 18:33:07.748834 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 236/449] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:33:07 2022] POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:33:07.757506 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0b22f73c-4a7a-4d72-92c2-1d88be7f1c8d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:07.758115 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0b22f73c-4a7a-4d72-92c2-1d88be7f1c8d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:07.764914 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0b22f73c-4a7a-4d72-92c2-1d88be7f1c8d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:07.765517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0b22f73c-4a7a-4d72-92c2-1d88be7f1c8d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:07.766512 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0b22f73c-4a7a-4d72-92c2-1d88be7f1c8d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:07.767144 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0b22f73c-4a7a-4d72-92c2-1d88be7f1c8d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:07.935629 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0b22f73c-4a7a-4d72-92c2-1d88be7f1c8d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:07.939572 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:07.944985 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0b22f73c-4a7a-4d72-92c2-1d88be7f1c8d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1708 microversion: 2.1 time: 0.191356 Jun 04 18:33:07.945756 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 214/450] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:07 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1708 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:08.008169 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-348996462", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "networks": [{"uuid": "f1e5e3df-f802-4f85-850f-f9e55828a5e1"}]}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:08.063014 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] validate_networks() for [('f1e5e3df-f802-4f85-850f-f9e55828a5e1', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:33:08.425002 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:33:08.425476 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:33:08.426004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:33:08.426434 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:33:08.426884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:33:08.436442 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:08.436894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:08.437958 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:08.439088 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:08.456037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Getting quotas for project b6ed2dc911c44ea0953b7c849e590a8a. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:33:08.460489 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Getting quotas for user d193c0fa3d934ba99e8929b2e2ab65c3 and project b6ed2dc911c44ea0953b7c849e590a8a. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:33:08.471921 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:33:08.474398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:33:08.523628 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e764cea3-366b-43cd-b7c2-80eb70271cac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520117 Jun 04 18:33:08.524297 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 237/451] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:33:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:33:08.534462 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-836b671a-beb6-4dee-904c-14c92d7f5ace tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:08.535161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-836b671a-beb6-4dee-904c-14c92d7f5ace tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:08.591500 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-836b671a-beb6-4dee-904c-14c92d7f5ace tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:08.599461 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-836b671a-beb6-4dee-904c-14c92d7f5ace tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1218 microversion: 2.1 time: 0.068975 Jun 04 18:33:08.600205 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 215/452] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:08 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:08.963461 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d62628d9-a7eb-4889-bf8c-4fac9d9ecf15 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:08.964112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d62628d9-a7eb-4889-bf8c-4fac9d9ecf15 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:08.971775 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d62628d9-a7eb-4889-bf8c-4fac9d9ecf15 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:08.972251 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d62628d9-a7eb-4889-bf8c-4fac9d9ecf15 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:08.973017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d62628d9-a7eb-4889-bf8c-4fac9d9ecf15 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:08.973446 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d62628d9-a7eb-4889-bf8c-4fac9d9ecf15 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:09.112794 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d62628d9-a7eb-4889-bf8c-4fac9d9ecf15 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:09.121737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d62628d9-a7eb-4889-bf8c-4fac9d9ecf15 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1708 microversion: 2.1 time: 0.162665 Jun 04 18:33:09.122301 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 238/453] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:08 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:09.618710 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dde305a1-a59c-4cf7-85e1-20cb02d73b8d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:09.619384 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dde305a1-a59c-4cf7-85e1-20cb02d73b8d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:09.628896 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dde305a1-a59c-4cf7-85e1-20cb02d73b8d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:09.629457 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dde305a1-a59c-4cf7-85e1-20cb02d73b8d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:09.630564 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dde305a1-a59c-4cf7-85e1-20cb02d73b8d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:09.630953 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dde305a1-a59c-4cf7-85e1-20cb02d73b8d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:09.704876 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dde305a1-a59c-4cf7-85e1-20cb02d73b8d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:09.712853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dde305a1-a59c-4cf7-85e1-20cb02d73b8d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1270 microversion: 2.1 time: 0.099212 Jun 04 18:33:09.713420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 216/454] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:09 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:10.139754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3ac5b128-a6e5-44b1-8b8e-c78f76dc0b66 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:10.141511 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3ac5b128-a6e5-44b1-8b8e-c78f76dc0b66 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:10.150631 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ac5b128-a6e5-44b1-8b8e-c78f76dc0b66 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:10.151083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ac5b128-a6e5-44b1-8b8e-c78f76dc0b66 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:10.152235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ac5b128-a6e5-44b1-8b8e-c78f76dc0b66 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:10.152638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ac5b128-a6e5-44b1-8b8e-c78f76dc0b66 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:10.293777 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3ac5b128-a6e5-44b1-8b8e-c78f76dc0b66 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:10.302257 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3ac5b128-a6e5-44b1-8b8e-c78f76dc0b66 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1712 microversion: 2.1 time: 0.167380 Jun 04 18:33:10.303067 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 239/455] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:10 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1712 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:10.729920 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-004bb01a-a415-4342-bd72-7fbbf72de7a4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:10.730541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-004bb01a-a415-4342-bd72-7fbbf72de7a4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:10.737608 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-004bb01a-a415-4342-bd72-7fbbf72de7a4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:10.738064 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-004bb01a-a415-4342-bd72-7fbbf72de7a4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:10.738838 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-004bb01a-a415-4342-bd72-7fbbf72de7a4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:10.739279 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-004bb01a-a415-4342-bd72-7fbbf72de7a4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:10.986603 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-004bb01a-a415-4342-bd72-7fbbf72de7a4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:10.994536 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-004bb01a-a415-4342-bd72-7fbbf72de7a4 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1318 microversion: 2.1 time: 0.268536 Jun 04 18:33:10.995087 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 217/456] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:10 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:11.415288 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-c38ce349-aa3d-42a9-83e8-a8a9d8f62a25 req-19e8688a-1ed6-43f9-8375-294dfb026204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841ea629-4e17-4812-ab31-0e43eb7e3b5b", "tag": "86e9b041-e400-47a1-8ac4-291b0829b281"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:11.420784 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:11.427163 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c38ce349-aa3d-42a9-83e8-a8a9d8f62a25 req-19e8688a-1ed6-43f9-8375-294dfb026204 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:11.427612 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c38ce349-aa3d-42a9-83e8-a8a9d8f62a25 req-19e8688a-1ed6-43f9-8375-294dfb026204 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:11.445158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-c38ce349-aa3d-42a9-83e8-a8a9d8f62a25 req-19e8688a-1ed6-43f9-8375-294dfb026204 service nova] Creating event network-changed:86e9b041-e400-47a1-8ac4-291b0829b281 for instance 841ea629-4e17-4812-ab31-0e43eb7e3b5b on hv-cinder-79053 Jun 04 18:33:11.450445 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-c38ce349-aa3d-42a9-83e8-a8a9d8f62a25 req-19e8688a-1ed6-43f9-8375-294dfb026204 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039172 Jun 04 18:33:11.451055 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 240/457] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:33:12.012361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-71727bec-d41d-4e75-abca-fbbe58aa2bd1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:12.012942 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-71727bec-d41d-4e75-abca-fbbe58aa2bd1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:12.020042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-71727bec-d41d-4e75-abca-fbbe58aa2bd1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:12.020510 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-71727bec-d41d-4e75-abca-fbbe58aa2bd1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:12.021275 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-71727bec-d41d-4e75-abca-fbbe58aa2bd1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:12.021713 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-71727bec-d41d-4e75-abca-fbbe58aa2bd1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:12.165896 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-71727bec-d41d-4e75-abca-fbbe58aa2bd1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:12.173792 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-71727bec-d41d-4e75-abca-fbbe58aa2bd1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1318 microversion: 2.1 time: 0.165421 Jun 04 18:33:12.174351 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 218/458] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:12 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:13.192196 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-701a82bf-bbb9-42d4-b9b2-b86011e8a912 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:13.192888 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-701a82bf-bbb9-42d4-b9b2-b86011e8a912 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:13.199594 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-701a82bf-bbb9-42d4-b9b2-b86011e8a912 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:13.200050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-701a82bf-bbb9-42d4-b9b2-b86011e8a912 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:13.200842 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-701a82bf-bbb9-42d4-b9b2-b86011e8a912 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:13.201279 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-701a82bf-bbb9-42d4-b9b2-b86011e8a912 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:13.343572 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-701a82bf-bbb9-42d4-b9b2-b86011e8a912 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:13.354742 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-701a82bf-bbb9-42d4-b9b2-b86011e8a912 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1318 microversion: 2.1 time: 0.167193 Jun 04 18:33:13.355429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 241/459] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:13 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:14.376097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0c214e68-e8c1-4a03-a0ec-a71aaa6ba05d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:14.377163 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0c214e68-e8c1-4a03-a0ec-a71aaa6ba05d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:14.380785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:14.389917 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c214e68-e8c1-4a03-a0ec-a71aaa6ba05d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:14.390632 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c214e68-e8c1-4a03-a0ec-a71aaa6ba05d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:14.391413 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c214e68-e8c1-4a03-a0ec-a71aaa6ba05d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:14.391838 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c214e68-e8c1-4a03-a0ec-a71aaa6ba05d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:14.537810 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0c214e68-e8c1-4a03-a0ec-a71aaa6ba05d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:14.545308 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0c214e68-e8c1-4a03-a0ec-a71aaa6ba05d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1318 microversion: 2.1 time: 0.175793 Jun 04 18:33:14.545865 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 219/460] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:14 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:15.566129 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c72c4aa8-7fa0-4c55-9fca-9cd5fb8b568d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:15.566803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c72c4aa8-7fa0-4c55-9fca-9cd5fb8b568d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:15.575571 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c72c4aa8-7fa0-4c55-9fca-9cd5fb8b568d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:15.576178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c72c4aa8-7fa0-4c55-9fca-9cd5fb8b568d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:15.577134 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c72c4aa8-7fa0-4c55-9fca-9cd5fb8b568d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:15.578127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c72c4aa8-7fa0-4c55-9fca-9cd5fb8b568d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:15.724147 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c72c4aa8-7fa0-4c55-9fca-9cd5fb8b568d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:15.731745 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c72c4aa8-7fa0-4c55-9fca-9cd5fb8b568d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1318 microversion: 2.1 time: 0.171891 Jun 04 18:33:15.732335 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 242/461] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:15 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:16.749117 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-366dcd8d-c46a-43b1-8cc3-a6b0b1b30575 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:16.749916 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-366dcd8d-c46a-43b1-8cc3-a6b0b1b30575 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:16.757110 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-366dcd8d-c46a-43b1-8cc3-a6b0b1b30575 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:16.757562 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-366dcd8d-c46a-43b1-8cc3-a6b0b1b30575 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:16.758333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-366dcd8d-c46a-43b1-8cc3-a6b0b1b30575 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:16.758773 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-366dcd8d-c46a-43b1-8cc3-a6b0b1b30575 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:17.162655 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-366dcd8d-c46a-43b1-8cc3-a6b0b1b30575 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:17.171993 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-366dcd8d-c46a-43b1-8cc3-a6b0b1b30575 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1318 microversion: 2.1 time: 0.426859 Jun 04 18:33:17.172625 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 220/462] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:16 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:18.189215 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b6b8ac77-1b32-4e52-bd9a-58cc9a6b9300 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:18.189813 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b6b8ac77-1b32-4e52-bd9a-58cc9a6b9300 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:18.196743 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b6b8ac77-1b32-4e52-bd9a-58cc9a6b9300 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:18.197190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b6b8ac77-1b32-4e52-bd9a-58cc9a6b9300 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:18.197956 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b6b8ac77-1b32-4e52-bd9a-58cc9a6b9300 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:18.198372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b6b8ac77-1b32-4e52-bd9a-58cc9a6b9300 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:18.341033 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b6b8ac77-1b32-4e52-bd9a-58cc9a6b9300 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:18.349692 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b6b8ac77-1b32-4e52-bd9a-58cc9a6b9300 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1318 microversion: 2.1 time: 0.164442 Jun 04 18:33:18.350541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 243/463] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:18 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:18.799925 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-f61c180a-c4f2-44b6-afb4-b4eb075ebbe2 req-08743548-9f1f-48b0-a84f-ab6b231e7aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841ea629-4e17-4812-ab31-0e43eb7e3b5b", "name": "network-vif-plugged", "status": "completed", "tag": "86e9b041-e400-47a1-8ac4-291b0829b281"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:18.805101 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:18.809062 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f61c180a-c4f2-44b6-afb4-b4eb075ebbe2 req-08743548-9f1f-48b0-a84f-ab6b231e7aa3 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:18.809677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f61c180a-c4f2-44b6-afb4-b4eb075ebbe2 req-08743548-9f1f-48b0-a84f-ab6b231e7aa3 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:18.822619 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-f61c180a-c4f2-44b6-afb4-b4eb075ebbe2 req-08743548-9f1f-48b0-a84f-ab6b231e7aa3 service nova] Creating event network-vif-plugged:86e9b041-e400-47a1-8ac4-291b0829b281 for instance 841ea629-4e17-4812-ab31-0e43eb7e3b5b on hv-cinder-79053 Jun 04 18:33:18.828104 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-f61c180a-c4f2-44b6-afb4-b4eb075ebbe2 req-08743548-9f1f-48b0-a84f-ab6b231e7aa3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032077 Jun 04 18:33:18.828864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 221/464] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:33:19.371240 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cbe1e09f-0206-4827-b35a-654ed9994854 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:19.372290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cbe1e09f-0206-4827-b35a-654ed9994854 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:19.377749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:19.378790 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:19.386084 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbe1e09f-0206-4827-b35a-654ed9994854 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:19.386839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbe1e09f-0206-4827-b35a-654ed9994854 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:19.388167 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbe1e09f-0206-4827-b35a-654ed9994854 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:19.388891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbe1e09f-0206-4827-b35a-654ed9994854 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:19.533494 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cbe1e09f-0206-4827-b35a-654ed9994854 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:19.541929 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cbe1e09f-0206-4827-b35a-654ed9994854 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1318 microversion: 2.1 time: 0.177205 Jun 04 18:33:19.542492 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 244/465] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:19 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:20.564231 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e251d232-ed0e-4d7c-9ee5-12445e54e9e7 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:20.564926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e251d232-ed0e-4d7c-9ee5-12445e54e9e7 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:20.571821 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e251d232-ed0e-4d7c-9ee5-12445e54e9e7 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:20.572505 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e251d232-ed0e-4d7c-9ee5-12445e54e9e7 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:20.573279 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e251d232-ed0e-4d7c-9ee5-12445e54e9e7 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:20.573709 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e251d232-ed0e-4d7c-9ee5-12445e54e9e7 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:20.717616 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e251d232-ed0e-4d7c-9ee5-12445e54e9e7 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:20.725602 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e251d232-ed0e-4d7c-9ee5-12445e54e9e7 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1318 microversion: 2.1 time: 0.168762 Jun 04 18:33:20.726195 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 222/466] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:20 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:21.748400 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4f78b16b-6812-4c90-90db-680c4cf911c1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:21.749208 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4f78b16b-6812-4c90-90db-680c4cf911c1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:21.758089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f78b16b-6812-4c90-90db-680c4cf911c1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:21.758680 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f78b16b-6812-4c90-90db-680c4cf911c1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:21.759646 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f78b16b-6812-4c90-90db-680c4cf911c1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:21.760274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f78b16b-6812-4c90-90db-680c4cf911c1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:21.899278 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4f78b16b-6812-4c90-90db-680c4cf911c1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:21.911374 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4f78b16b-6812-4c90-90db-680c4cf911c1 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1507 microversion: 2.1 time: 0.167705 Jun 04 18:33:21.912734 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 245/467] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:21 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:21.935354 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3e5f0568-f415-4c47-a7ad-30f2e3580e56 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88f3eb8d-42df-4609-89a8-6fe17fe9d5ae", "device": "/dev/sdb"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:21.936842 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3e5f0568-f415-4c47-a7ad-30f2e3580e56 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:21.947060 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e5f0568-f415-4c47-a7ad-30f2e3580e56 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:21.947687 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e5f0568-f415-4c47-a7ad-30f2e3580e56 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:21.948865 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e5f0568-f415-4c47-a7ad-30f2e3580e56 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:21.949479 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e5f0568-f415-4c47-a7ad-30f2e3580e56 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:22.216186 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3e5f0568-f415-4c47-a7ad-30f2e3580e56 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "POST /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286824 Jun 04 18:33:22.216870 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 223/468] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:33:21 2022] POST /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:33:39.899744 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2a833d2e-892f-46eb-9240-9d889cd3b082 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:39.900400 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2a833d2e-892f-46eb-9240-9d889cd3b082 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:39.902481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=11 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:39.903126 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=46 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:39.908948 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a833d2e-892f-46eb-9240-9d889cd3b082 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:39.909399 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a833d2e-892f-46eb-9240-9d889cd3b082 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:39.910172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a833d2e-892f-46eb-9240-9d889cd3b082 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:39.910612 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a833d2e-892f-46eb-9240-9d889cd3b082 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:39.934951 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2a833d2e-892f-46eb-9240-9d889cd3b082 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/ips" status: 200 len: 151 microversion: 2.1 time: 0.039432 Jun 04 18:33:39.935528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 246/469] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:33:39 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:33:42.348395 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=9 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:42.349181 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:42.353795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ea4ab143-86b9-4383-a315-a95073a8e541 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a39998-6ea5-4052-95e1-eb0d97642622"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:42.354943 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ea4ab143-86b9-4383-a315-a95073a8e541 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:42.362551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ea4ab143-86b9-4383-a315-a95073a8e541 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:42.363057 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ea4ab143-86b9-4383-a315-a95073a8e541 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:42.363823 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ea4ab143-86b9-4383-a315-a95073a8e541 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:42.364288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ea4ab143-86b9-4383-a315-a95073a8e541 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:42.640396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ea4ab143-86b9-4383-a315-a95073a8e541 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293186 Jun 04 18:33:42.640997 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 224/470] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:33:42 2022] POST /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:33:44.780656 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-95f9d7dd-ee56-440d-bcf5-6c491f6ccdf3 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:44.781219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-95f9d7dd-ee56-440d-bcf5-6c491f6ccdf3 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:44.789070 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-95f9d7dd-ee56-440d-bcf5-6c491f6ccdf3 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:44.789527 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-95f9d7dd-ee56-440d-bcf5-6c491f6ccdf3 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:44.790287 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-95f9d7dd-ee56-440d-bcf5-6c491f6ccdf3 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:44.790718 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-95f9d7dd-ee56-440d-bcf5-6c491f6ccdf3 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:44.930521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-95f9d7dd-ee56-440d-bcf5-6c491f6ccdf3 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lazy-loading 'services' on Instance uuid 841ea629-4e17-4812-ab31-0e43eb7e3b5b {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:33:45.062057 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-95f9d7dd-ee56-440d-bcf5-6c491f6ccdf3 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "DELETE /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b/os-volume_attachments/88f3eb8d-42df-4609-89a8-6fe17fe9d5ae" status: 202 len: 0 microversion: 2.1 time: 0.285226 Jun 04 18:33:45.062861 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 247/471] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:33:44 2022] DELETE /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b/os-volume_attachments/88f3eb8d-42df-4609-89a8-6fe17fe9d5ae => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:33:50.191716 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-76c6bb53-56b8-40bf-b4b5-593b5a0c7617 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: .version_select at 0x7f467e12a040>, body: {"keypair": {"name": "tempest-keypair-1421671281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy86BySGlVtVA9UA6MYnq1Q8QHQLVrQiWEo7bb5kD5h9QZ763PntF1SYnO/+27wmQcCGdjBozF3sEdgI8uxxhMkIcsJLk1TLsruiX3Vu6YflPlg7hGq6RVRqm8JdpDdvA=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:50.206427 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-76c6bb53-56b8-40bf-b4b5-593b5a0c7617 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:33:50.210303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-76c6bb53-56b8-40bf-b4b5-593b5a0c7617 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for user 5b5a9f5cdfa6494d97617d68880d5552 and project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:33:50.237551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-76c6bb53-56b8-40bf-b4b5-593b5a0c7617 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050698 Jun 04 18:33:50.243174 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 225/472] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:33:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:33:50.439296 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6f8cffb7-32b3-4a60-b06f-ebc55f0b1201 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:50.440502 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6f8cffb7-32b3-4a60-b06f-ebc55f0b1201 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:50.446356 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6f8cffb7-32b3-4a60-b06f-ebc55f0b1201 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:50.446800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6f8cffb7-32b3-4a60-b06f-ebc55f0b1201 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:50.447563 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6f8cffb7-32b3-4a60-b06f-ebc55f0b1201 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:50.447991 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6f8cffb7-32b3-4a60-b06f-ebc55f0b1201 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:50.473117 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6f8cffb7-32b3-4a60-b06f-ebc55f0b1201 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:33:50.554125 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6f8cffb7-32b3-4a60-b06f-ebc55f0b1201 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "DELETE /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 204 len: 0 microversion: 2.1 time: 0.119438 Jun 04 18:33:50.554821 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 248/473] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:33:50 2022] DELETE /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:33:50.563765 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02e46404-f64e-4d13-a6b3-a918ddfd2810 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:50.564503 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02e46404-f64e-4d13-a6b3-a918ddfd2810 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:50.571463 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e46404-f64e-4d13-a6b3-a918ddfd2810 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:50.571977 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e46404-f64e-4d13-a6b3-a918ddfd2810 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:50.572939 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e46404-f64e-4d13-a6b3-a918ddfd2810 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:50.573437 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e46404-f64e-4d13-a6b3-a918ddfd2810 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:50.855375 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02e46404-f64e-4d13-a6b3-a918ddfd2810 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:50.863853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02e46404-f64e-4d13-a6b3-a918ddfd2810 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1513 microversion: 2.1 time: 0.304544 Jun 04 18:33:50.864497 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 226/474] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:50 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1513 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:51.806133 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1307494623", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2590cab-faa4-4157-aaba-3c7a446c9e61"}], "security_groups": [{"name": "tempest-securitygroup--2104176276"}], "key_name": "tempest-keypair-1421671281", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:51.881120 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e1d41764-99d2-4dad-a67a-aa0667ffb415 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:51.881748 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e1d41764-99d2-4dad-a67a-aa0667ffb415 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:51.888549 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1d41764-99d2-4dad-a67a-aa0667ffb415 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:51.888977 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1d41764-99d2-4dad-a67a-aa0667ffb415 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:51.889752 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1d41764-99d2-4dad-a67a-aa0667ffb415 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:51.890222 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1d41764-99d2-4dad-a67a-aa0667ffb415 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:52.014923 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:33:52.015178 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Sat Jun 4 18:33:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b (ip 10.222.0.39) !!! Jun 04 18:33:52.024257 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e1d41764-99d2-4dad-a67a-aa0667ffb415 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:52.032249 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e1d41764-99d2-4dad-a67a-aa0667ffb415 tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1513 microversion: 2.1 time: 0.154996 Jun 04 18:33:52.032828 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 227/475] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:51 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:52.040449 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] validate_networks() for [('e2590cab-faa4-4157-aaba-3c7a446c9e61', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:33:52.419438 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:33:52.419861 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:33:52.420583 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:33:52.421204 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:33:52.421788 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:33:52.436598 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:52.437272 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:52.438495 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:52.439151 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:52.459297 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:33:52.463557 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for user 5b5a9f5cdfa6494d97617d68880d5552 and project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:33:52.475256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:33:52.477698 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:33:52.530622 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f38a7422-9870-4af5-8d25-e6eb8f88f6ca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.729905 Jun 04 18:33:52.531437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 249/476] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:33:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:33:52.542434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e2eecb87-b827-43a2-8e3f-cd1bb7f3986d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:52.543051 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e2eecb87-b827-43a2-8e3f-cd1bb7f3986d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:52.612645 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e2eecb87-b827-43a2-8e3f-cd1bb7f3986d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:52.619848 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e2eecb87-b827-43a2-8e3f-cd1bb7f3986d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1242 microversion: 2.1 time: 0.081998 Jun 04 18:33:52.620449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 228/477] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:52 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:53.035652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-4c06a862-2388-4bbc-9df5-aaf4ff942c54 req-3b832f5b-d99d-4584-b2cf-5e4f7c466df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841ea629-4e17-4812-ab31-0e43eb7e3b5b", "name": "network-vif-deleted", "tag": "86e9b041-e400-47a1-8ac4-291b0829b281"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:53.048141 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-4c06a862-2388-4bbc-9df5-aaf4ff942c54 req-3b832f5b-d99d-4584-b2cf-5e4f7c466df7 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:53.048726 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-4c06a862-2388-4bbc-9df5-aaf4ff942c54 req-3b832f5b-d99d-4584-b2cf-5e4f7c466df7 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:53.050376 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-95947fcf-66f5-44a0-8f2b-b7c1d15a31ac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:53.051339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-95947fcf-66f5-44a0-8f2b-b7c1d15a31ac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:53.059189 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95947fcf-66f5-44a0-8f2b-b7c1d15a31ac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:53.059653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95947fcf-66f5-44a0-8f2b-b7c1d15a31ac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:53.060469 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95947fcf-66f5-44a0-8f2b-b7c1d15a31ac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:53.060943 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95947fcf-66f5-44a0-8f2b-b7c1d15a31ac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:53.075122 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-4c06a862-2388-4bbc-9df5-aaf4ff942c54 req-3b832f5b-d99d-4584-b2cf-5e4f7c466df7 service nova] Creating event network-vif-deleted:86e9b041-e400-47a1-8ac4-291b0829b281 for instance 841ea629-4e17-4812-ab31-0e43eb7e3b5b on hv-cinder-79053 Jun 04 18:33:53.080732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-4c06a862-2388-4bbc-9df5-aaf4ff942c54 req-3b832f5b-d99d-4584-b2cf-5e4f7c466df7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049027 Jun 04 18:33:53.082412 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 250/478] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:33:53.142631 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-95947fcf-66f5-44a0-8f2b-b7c1d15a31ac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd193c0fa3d934ba99e8929b2e2ab65c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ed2dc911c44ea0953b7c849e590a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:53.150392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-95947fcf-66f5-44a0-8f2b-b7c1d15a31ac tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 200 len: 1303 microversion: 2.1 time: 0.104353 Jun 04 18:33:53.152718 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 229/479] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:53 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:53.642898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-99cc78bd-b3c3-4184-9432-2a1940363bfb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:53.643921 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-99cc78bd-b3c3-4184-9432-2a1940363bfb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:53.653416 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99cc78bd-b3c3-4184-9432-2a1940363bfb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:53.653864 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99cc78bd-b3c3-4184-9432-2a1940363bfb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:53.654629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99cc78bd-b3c3-4184-9432-2a1940363bfb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:53.655067 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99cc78bd-b3c3-4184-9432-2a1940363bfb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:53.745318 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-99cc78bd-b3c3-4184-9432-2a1940363bfb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:53.752991 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-99cc78bd-b3c3-4184-9432-2a1940363bfb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1294 microversion: 2.1 time: 0.117403 Jun 04 18:33:53.753734 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 251/480] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:53 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:54.168508 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:54.169153 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] [instance: 841ea629-4e17-4812-ab31-0e43eb7e3b5b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:54.175812 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:54.176293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:54.177094 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:54.177553 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:54.191820 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] HTTP exception thrown: Instance 841ea629-4e17-4812-ab31-0e43eb7e3b5b could not be found. Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Request method failure captured: Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b HTTP/1.1 Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6T2TjU29qvntah1GLxOLQjOSIpaqMOG_rfBNJ9gxdzzeRzomtybV5pdIrNdxoDN6rA47jBw1oPwu1nfl4-SkWicXVO6L3r6Th-9R8-sGrToHPoQej8YwOeHZOWIH5aN449wGqb10EiRmxvXlAXkrLEY3MrYTmhHbQSxh2T5IjSyafo Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: b6ed2dc911c44ea0953b7c849e590a8a Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1307654825 Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:33:54.193424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6ed2dc911c44ea0953b7c849e590a8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b6ed2dc911c44ea0953b7c849e590a8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b6ed2dc911c44ea0953b7c849e590a8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6ed2dc911c44ea0953b7c849e590a8a"}]}] Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesSnapshotTestJSON-1307654825 Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b6ed2dc911c44ea0953b7c849e590a8a Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1307654825 Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesSnapshotTestJSON-1307654825-project Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: d193c0fa3d934ba99e8929b2e2ab65c3 Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesSnapshotTestJSON-1307654825-project Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 841ea629-4e17-4812-ab31-0e43eb7e3b5b could not be found. Jun 04 18:33:54.194991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '841ea629-4e17-4812-ab31-0e43eb7e3b5b'} Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841ea629-4e17-4812-ab31-0e43eb7e3b5b could not be found. Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:33:54.195862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841ea629-4e17-4812-ab31-0e43eb7e3b5b could not be found. Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841ea629-4e17-4812-ab31-0e43eb7e3b5b could not be found. Jun 04 18:33:54.197864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:33:54.199517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] Returning 404 to user: Instance 841ea629-4e17-4812-ab31-0e43eb7e3b5b could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:33:54.199517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6ac821af-4f31-4ea8-8db7-0f5679cba96d tempest-VolumesSnapshotTestJSON-1307654825 tempest-VolumesSnapshotTestJSON-1307654825-project] 10.222.0.39 "GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b" status: 404 len: 111 microversion: 2.1 time: 0.030545 Jun 04 18:33:54.199517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 230/481] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:54 2022] GET /compute/v2.1/servers/841ea629-4e17-4812-ab31-0e43eb7e3b5b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:33:54.774196 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dc6e2a59-2f89-4eba-91c5-afe506db6c26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:54.775360 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dc6e2a59-2f89-4eba-91c5-afe506db6c26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:54.786589 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dc6e2a59-2f89-4eba-91c5-afe506db6c26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:54.787272 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dc6e2a59-2f89-4eba-91c5-afe506db6c26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:54.788491 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dc6e2a59-2f89-4eba-91c5-afe506db6c26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:54.789162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dc6e2a59-2f89-4eba-91c5-afe506db6c26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:54.940579 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dc6e2a59-2f89-4eba-91c5-afe506db6c26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:54.948366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dc6e2a59-2f89-4eba-91c5-afe506db6c26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.180711 Jun 04 18:33:54.948928 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 252/482] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:54 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:55.370736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-d5b84051-f268-4c5b-9cba-27b142e2518f req-e0d7b5f1-5c43-46b5-8d09-258b79668166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1205f37f-ca68-4d25-83e9-ad88c6f52c54", "tag": "99370f44-721a-4281-9290-53ddfa929801"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:33:55.380117 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d5b84051-f268-4c5b-9cba-27b142e2518f req-e0d7b5f1-5c43-46b5-8d09-258b79668166 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:55.380829 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d5b84051-f268-4c5b-9cba-27b142e2518f req-e0d7b5f1-5c43-46b5-8d09-258b79668166 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:55.397882 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-d5b84051-f268-4c5b-9cba-27b142e2518f req-e0d7b5f1-5c43-46b5-8d09-258b79668166 service nova] Creating event network-changed:99370f44-721a-4281-9290-53ddfa929801 for instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 on hv-cinder-79053 Jun 04 18:33:55.403496 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-d5b84051-f268-4c5b-9cba-27b142e2518f req-e0d7b5f1-5c43-46b5-8d09-258b79668166 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036482 Jun 04 18:33:55.404602 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 231/483] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:33:55.965893 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e3014910-8e91-411b-8073-94077597d45e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:55.966497 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e3014910-8e91-411b-8073-94077597d45e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:55.973054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3014910-8e91-411b-8073-94077597d45e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:55.973497 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3014910-8e91-411b-8073-94077597d45e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:55.974233 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3014910-8e91-411b-8073-94077597d45e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:55.974693 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3014910-8e91-411b-8073-94077597d45e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:56.121573 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e3014910-8e91-411b-8073-94077597d45e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:56.129427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e3014910-8e91-411b-8073-94077597d45e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.167565 Jun 04 18:33:56.129990 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 253/484] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:55 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:57.147821 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0eb7f19c-2795-42a5-8d65-0991e04234f1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:57.148540 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0eb7f19c-2795-42a5-8d65-0991e04234f1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:57.155962 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0eb7f19c-2795-42a5-8d65-0991e04234f1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:57.156454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0eb7f19c-2795-42a5-8d65-0991e04234f1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:57.157224 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0eb7f19c-2795-42a5-8d65-0991e04234f1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:57.157666 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0eb7f19c-2795-42a5-8d65-0991e04234f1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:57.300373 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0eb7f19c-2795-42a5-8d65-0991e04234f1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:57.309034 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0eb7f19c-2795-42a5-8d65-0991e04234f1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.166009 Jun 04 18:33:57.309619 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 232/485] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:57 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:58.327264 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3ce54290-86d6-4aa6-8c9a-b03385910838 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:58.327874 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3ce54290-86d6-4aa6-8c9a-b03385910838 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:58.334807 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ce54290-86d6-4aa6-8c9a-b03385910838 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:58.335250 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ce54290-86d6-4aa6-8c9a-b03385910838 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:58.336019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ce54290-86d6-4aa6-8c9a-b03385910838 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:58.336464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ce54290-86d6-4aa6-8c9a-b03385910838 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:58.473107 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3ce54290-86d6-4aa6-8c9a-b03385910838 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:58.482319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3ce54290-86d6-4aa6-8c9a-b03385910838 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.158908 Jun 04 18:33:58.482879 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 254/486] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:58 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:33:59.499507 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2f3ee868-1ae4-49cc-896d-2e6ba8eac312 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:33:59.500148 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2f3ee868-1ae4-49cc-896d-2e6ba8eac312 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:33:59.506984 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f3ee868-1ae4-49cc-896d-2e6ba8eac312 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:59.507432 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f3ee868-1ae4-49cc-896d-2e6ba8eac312 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:59.508233 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f3ee868-1ae4-49cc-896d-2e6ba8eac312 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:33:59.508694 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f3ee868-1ae4-49cc-896d-2e6ba8eac312 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:33:59.644596 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2f3ee868-1ae4-49cc-896d-2e6ba8eac312 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:33:59.654339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2f3ee868-1ae4-49cc-896d-2e6ba8eac312 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.158802 Jun 04 18:33:59.654909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 233/487] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:33:59 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:00.677873 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d31b6229-9355-4999-9a13-d5a884ad1a8b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:00.678839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d31b6229-9355-4999-9a13-d5a884ad1a8b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:00.689546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d31b6229-9355-4999-9a13-d5a884ad1a8b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:00.690290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d31b6229-9355-4999-9a13-d5a884ad1a8b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:00.691536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d31b6229-9355-4999-9a13-d5a884ad1a8b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:00.692310 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d31b6229-9355-4999-9a13-d5a884ad1a8b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:00.823954 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d31b6229-9355-4999-9a13-d5a884ad1a8b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:00.835584 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d31b6229-9355-4999-9a13-d5a884ad1a8b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.163854 Jun 04 18:34:00.836446 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 255/488] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:00 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:01.857686 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-259207db-ed96-4185-a40c-5c8e13a5b2e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:01.858661 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-259207db-ed96-4185-a40c-5c8e13a5b2e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:01.870245 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-259207db-ed96-4185-a40c-5c8e13a5b2e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:01.870711 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-259207db-ed96-4185-a40c-5c8e13a5b2e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:01.871451 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-259207db-ed96-4185-a40c-5c8e13a5b2e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:01.871852 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-259207db-ed96-4185-a40c-5c8e13a5b2e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:02.009673 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-259207db-ed96-4185-a40c-5c8e13a5b2e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:02.017884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-259207db-ed96-4185-a40c-5c8e13a5b2e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.167544 Jun 04 18:34:02.018441 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 234/489] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:01 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:03.040439 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-faf483eb-b38e-4f84-8687-bfd164e2c07b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:03.041448 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-faf483eb-b38e-4f84-8687-bfd164e2c07b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:03.045702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:03.046736 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:03.057515 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-faf483eb-b38e-4f84-8687-bfd164e2c07b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:03.057966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-faf483eb-b38e-4f84-8687-bfd164e2c07b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:03.058719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-faf483eb-b38e-4f84-8687-bfd164e2c07b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:03.059189 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-faf483eb-b38e-4f84-8687-bfd164e2c07b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:03.198796 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-faf483eb-b38e-4f84-8687-bfd164e2c07b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:03.206604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-faf483eb-b38e-4f84-8687-bfd164e2c07b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.173220 Jun 04 18:34:03.207517 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 256/490] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:03 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:04.224335 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b32c2846-9ddd-4898-9312-3356734c54df tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:04.224927 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b32c2846-9ddd-4898-9312-3356734c54df tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:04.226947 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:04.233887 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b32c2846-9ddd-4898-9312-3356734c54df tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:04.234329 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b32c2846-9ddd-4898-9312-3356734c54df tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:04.235098 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b32c2846-9ddd-4898-9312-3356734c54df tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:04.235531 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b32c2846-9ddd-4898-9312-3356734c54df tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:04.373951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b32c2846-9ddd-4898-9312-3356734c54df tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:04.381930 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b32c2846-9ddd-4898-9312-3356734c54df tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.161542 Jun 04 18:34:04.382493 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 235/491] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:04 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:05.398990 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1165c3e1-a8f1-4ed7-a964-7aa4ce7923e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:05.399562 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1165c3e1-a8f1-4ed7-a964-7aa4ce7923e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:05.406702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1165c3e1-a8f1-4ed7-a964-7aa4ce7923e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:05.407147 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1165c3e1-a8f1-4ed7-a964-7aa4ce7923e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:05.407894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1165c3e1-a8f1-4ed7-a964-7aa4ce7923e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:05.408349 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1165c3e1-a8f1-4ed7-a964-7aa4ce7923e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:05.541275 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1165c3e1-a8f1-4ed7-a964-7aa4ce7923e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:05.553477 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1165c3e1-a8f1-4ed7-a964-7aa4ce7923e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.158099 Jun 04 18:34:05.554181 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 257/492] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:05 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:06.574572 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-65c7f8f2-6f0a-4025-9f9f-02a551d42bb8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:06.575121 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-65c7f8f2-6f0a-4025-9f9f-02a551d42bb8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:06.582403 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-65c7f8f2-6f0a-4025-9f9f-02a551d42bb8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:06.582874 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-65c7f8f2-6f0a-4025-9f9f-02a551d42bb8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:06.583689 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-65c7f8f2-6f0a-4025-9f9f-02a551d42bb8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:06.584187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-65c7f8f2-6f0a-4025-9f9f-02a551d42bb8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:06.722424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-65c7f8f2-6f0a-4025-9f9f-02a551d42bb8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:06.730633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-65c7f8f2-6f0a-4025-9f9f-02a551d42bb8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.163151 Jun 04 18:34:06.731197 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 236/493] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:06 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:07.756546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-82f20768-24f6-4c7e-8beb-70e631793d29 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:07.757550 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-82f20768-24f6-4c7e-8beb-70e631793d29 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:07.769261 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82f20768-24f6-4c7e-8beb-70e631793d29 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:07.769966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82f20768-24f6-4c7e-8beb-70e631793d29 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:07.771225 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82f20768-24f6-4c7e-8beb-70e631793d29 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:07.771973 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82f20768-24f6-4c7e-8beb-70e631793d29 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:07.901341 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-82f20768-24f6-4c7e-8beb-70e631793d29 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:07.909183 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-82f20768-24f6-4c7e-8beb-70e631793d29 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.159225 Jun 04 18:34:07.909780 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 258/494] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:07 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:08.932239 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e6289d31-c1cf-4eef-a064-9e71fe0b62e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:08.933315 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e6289d31-c1cf-4eef-a064-9e71fe0b62e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:08.944807 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e6289d31-c1cf-4eef-a064-9e71fe0b62e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:08.945622 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e6289d31-c1cf-4eef-a064-9e71fe0b62e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:08.946885 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e6289d31-c1cf-4eef-a064-9e71fe0b62e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:08.947610 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e6289d31-c1cf-4eef-a064-9e71fe0b62e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:09.324687 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e6289d31-c1cf-4eef-a064-9e71fe0b62e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:09.332624 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e6289d31-c1cf-4eef-a064-9e71fe0b62e6 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.406845 Jun 04 18:34:09.333184 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 237/495] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:08 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:09.597410 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-db36557d-0da8-44b7-947c-533c95ad6948 req-06ab5267-fcb9-490b-b86e-6db0548210f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1205f37f-ca68-4d25-83e9-ad88c6f52c54", "name": "network-vif-plugged", "status": "completed", "tag": "99370f44-721a-4281-9290-53ddfa929801"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:34:09.607495 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-db36557d-0da8-44b7-947c-533c95ad6948 req-06ab5267-fcb9-490b-b86e-6db0548210f2 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:09.607955 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-db36557d-0da8-44b7-947c-533c95ad6948 req-06ab5267-fcb9-490b-b86e-6db0548210f2 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:09.622588 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-db36557d-0da8-44b7-947c-533c95ad6948 req-06ab5267-fcb9-490b-b86e-6db0548210f2 service nova] Creating event network-vif-plugged:99370f44-721a-4281-9290-53ddfa929801 for instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 on hv-cinder-79053 Jun 04 18:34:09.627649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-db36557d-0da8-44b7-947c-533c95ad6948 req-06ab5267-fcb9-490b-b86e-6db0548210f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034423 Jun 04 18:34:09.628260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 259/496] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:34:10.349928 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d8dd75a5-a5be-4f87-b2e3-b671a5b94362 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:10.350537 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d8dd75a5-a5be-4f87-b2e3-b671a5b94362 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:10.364579 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8dd75a5-a5be-4f87-b2e3-b671a5b94362 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:10.364579 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8dd75a5-a5be-4f87-b2e3-b671a5b94362 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:10.364579 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8dd75a5-a5be-4f87-b2e3-b671a5b94362 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:10.364579 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8dd75a5-a5be-4f87-b2e3-b671a5b94362 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:10.496603 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d8dd75a5-a5be-4f87-b2e3-b671a5b94362 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:10.504517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d8dd75a5-a5be-4f87-b2e3-b671a5b94362 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.158476 Jun 04 18:34:10.505103 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 238/497] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:10 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:11.523070 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b142c195-77d9-4c60-af1b-adc92fa4358e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:11.523804 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b142c195-77d9-4c60-af1b-adc92fa4358e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:11.525870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:11.531633 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b142c195-77d9-4c60-af1b-adc92fa4358e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:11.532105 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b142c195-77d9-4c60-af1b-adc92fa4358e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:11.532867 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b142c195-77d9-4c60-af1b-adc92fa4358e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:11.533318 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b142c195-77d9-4c60-af1b-adc92fa4358e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:11.538351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:11.678728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b142c195-77d9-4c60-af1b-adc92fa4358e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:11.686883 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b142c195-77d9-4c60-af1b-adc92fa4358e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1368 microversion: 2.1 time: 0.168494 Jun 04 18:34:11.687500 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 260/498] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:11 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:12.704173 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-35686efb-3e6e-4664-9e0e-130ed8dcfe17 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:12.704783 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-35686efb-3e6e-4664-9e0e-130ed8dcfe17 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:12.707102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:12.713849 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35686efb-3e6e-4664-9e0e-130ed8dcfe17 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:12.714414 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35686efb-3e6e-4664-9e0e-130ed8dcfe17 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:12.715283 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35686efb-3e6e-4664-9e0e-130ed8dcfe17 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:12.715716 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35686efb-3e6e-4664-9e0e-130ed8dcfe17 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:12.720316 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:12.849792 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-35686efb-3e6e-4664-9e0e-130ed8dcfe17 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:12.857749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-35686efb-3e6e-4664-9e0e-130ed8dcfe17 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1559 microversion: 2.1 time: 0.157531 Jun 04 18:34:12.858321 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 239/499] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:12 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:12.874652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a0474ba6-82cc-445a-8374-df65c6001a10 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:12.875222 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a0474ba6-82cc-445a-8374-df65c6001a10 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:12.881729 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0474ba6-82cc-445a-8374-df65c6001a10 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:12.882177 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0474ba6-82cc-445a-8374-df65c6001a10 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:12.882940 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0474ba6-82cc-445a-8374-df65c6001a10 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:12.883364 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0474ba6-82cc-445a-8374-df65c6001a10 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:12.964195 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a0474ba6-82cc-445a-8374-df65c6001a10 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093829 Jun 04 18:34:12.964827 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 261/500] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 4 18:34:12 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:34:13.996580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-ee09b334-ed22-40dc-8631-ecf4edda8f0b req-8396ebf9-45b0-41e6-98ae-f59e29dd2864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1205f37f-ca68-4d25-83e9-ad88c6f52c54", "tag": "99370f44-721a-4281-9290-53ddfa929801"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:34:14.004937 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ee09b334-ed22-40dc-8631-ecf4edda8f0b req-8396ebf9-45b0-41e6-98ae-f59e29dd2864 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:14.005360 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ee09b334-ed22-40dc-8631-ecf4edda8f0b req-8396ebf9-45b0-41e6-98ae-f59e29dd2864 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:14.016856 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-ee09b334-ed22-40dc-8631-ecf4edda8f0b req-8396ebf9-45b0-41e6-98ae-f59e29dd2864 service nova] Creating event network-changed:99370f44-721a-4281-9290-53ddfa929801 for instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 on hv-cinder-79053 Jun 04 18:34:14.022389 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-ee09b334-ed22-40dc-8631-ecf4edda8f0b req-8396ebf9-45b0-41e6-98ae-f59e29dd2864 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090154 Jun 04 18:34:14.023201 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 240/501] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:34:27.341194 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:27.341981 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=9 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:27.594521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-32cc57e5-59d7-4b10-bf8e-0be7b8ed9ebd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0519c5a-05c6-4887-b2f6-9105c919d34b"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:34:27.595760 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-32cc57e5-59d7-4b10-bf8e-0be7b8ed9ebd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:27.602259 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-32cc57e5-59d7-4b10-bf8e-0be7b8ed9ebd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:27.603018 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-32cc57e5-59d7-4b10-bf8e-0be7b8ed9ebd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:27.603885 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-32cc57e5-59d7-4b10-bf8e-0be7b8ed9ebd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:27.604531 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-32cc57e5-59d7-4b10-bf8e-0be7b8ed9ebd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:27.893825 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-32cc57e5-59d7-4b10-bf8e-0be7b8ed9ebd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553458 Jun 04 18:34:27.894186 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 262/502] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:34:27 2022] POST /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:34:30.743417 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:30.744334 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=7 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:30.860422 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-203581dd-77af-4b9c-b1ae-03a86fd8713a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Action: 'create', calling method: .version_select at 0x7f467e073f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-493393868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV918LTEbhr3I3AYzb1pc5k2KQ+fqrPwh4w6EKB2bDglZD7uFE8zej6zlp6zXBKiK95LSW7xLEhF9LBfcV4KLdavH/4dJf3VZyJz4DFzvgsJeuGMx6jnqzYB1aA815s1g=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:34:30.874226 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-203581dd-77af-4b9c-b1ae-03a86fd8713a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Getting quotas for project 2829dcddd2864698b273038b8df5ce76. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:34:30.878035 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-203581dd-77af-4b9c-b1ae-03a86fd8713a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Getting quotas for user cf94c76ba04b403b91a7ff77a2f476e8 and project 2829dcddd2864698b273038b8df5ce76. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:34:30.902423 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-203581dd-77af-4b9c-b1ae-03a86fd8713a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.160365 Jun 04 18:34:30.903025 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 241/503] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:34:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:34:35.576528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9f2a3d66-9287-4017-a89f-67bd3cd0dc50 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:34:35.577751 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9f2a3d66-9287-4017-a89f-67bd3cd0dc50 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:35.584151 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f2a3d66-9287-4017-a89f-67bd3cd0dc50 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:35.584599 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f2a3d66-9287-4017-a89f-67bd3cd0dc50 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:35.585357 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f2a3d66-9287-4017-a89f-67bd3cd0dc50 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:35.585785 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f2a3d66-9287-4017-a89f-67bd3cd0dc50 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:35.610092 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-9f2a3d66-9287-4017-a89f-67bd3cd0dc50 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lazy-loading 'flavor' on Instance uuid 989409f2-e7e3-4010-b525-e7389d3eb160 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:34:35.742182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9f2a3d66-9287-4017-a89f-67bd3cd0dc50 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/action" status: 200 len: 32 microversion: 2.1 time: 0.170399 Jun 04 18:34:35.742588 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 263/504] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:34:35 2022] POST /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:34:35.751924 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8b4d540a-4e73-46d5-a232-bb2379c89697 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:35.752716 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8b4d540a-4e73-46d5-a232-bb2379c89697 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:35.760653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b4d540a-4e73-46d5-a232-bb2379c89697 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:35.761116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b4d540a-4e73-46d5-a232-bb2379c89697 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:35.761923 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b4d540a-4e73-46d5-a232-bb2379c89697 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:35.762391 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b4d540a-4e73-46d5-a232-bb2379c89697 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:35.987541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8b4d540a-4e73-46d5-a232-bb2379c89697 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:35.996340 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8b4d540a-4e73-46d5-a232-bb2379c89697 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.248125 Jun 04 18:34:35.996789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 242/505] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:35 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:37.019688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-71049527-fecb-4094-8a27-3fc6cb0183c5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:37.020796 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-71049527-fecb-4094-8a27-3fc6cb0183c5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:37.030651 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-71049527-fecb-4094-8a27-3fc6cb0183c5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:37.031109 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-71049527-fecb-4094-8a27-3fc6cb0183c5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:37.031888 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-71049527-fecb-4094-8a27-3fc6cb0183c5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:37.032369 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-71049527-fecb-4094-8a27-3fc6cb0183c5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:37.175543 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-71049527-fecb-4094-8a27-3fc6cb0183c5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:37.183688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-71049527-fecb-4094-8a27-3fc6cb0183c5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.170748 Jun 04 18:34:37.184305 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 264/506] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:37 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:38.205335 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ca56df94-c2a6-454c-85e1-8189450395fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:38.206058 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ca56df94-c2a6-454c-85e1-8189450395fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:38.215471 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ca56df94-c2a6-454c-85e1-8189450395fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:38.216256 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ca56df94-c2a6-454c-85e1-8189450395fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:38.217526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ca56df94-c2a6-454c-85e1-8189450395fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:38.218183 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ca56df94-c2a6-454c-85e1-8189450395fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:38.367489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ca56df94-c2a6-454c-85e1-8189450395fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:38.376321 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ca56df94-c2a6-454c-85e1-8189450395fd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.177464 Jun 04 18:34:38.376886 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 243/507] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:38 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:39.027297 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-48768664-408c-4607-a2c8-7290f8168de0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:34:39.028295 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-48768664-408c-4607-a2c8-7290f8168de0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:39.037763 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48768664-408c-4607-a2c8-7290f8168de0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:39.038304 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48768664-408c-4607-a2c8-7290f8168de0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:39.039121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48768664-408c-4607-a2c8-7290f8168de0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:39.039567 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48768664-408c-4607-a2c8-7290f8168de0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:39.130800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-48768664-408c-4607-a2c8-7290f8168de0 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "POST /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/action" status: 202 len: 0 microversion: 2.1 time: 0.107361 Jun 04 18:34:39.132241 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 265/508] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:34:39 2022] POST /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:34:39.139694 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8ea3a7d2-6221-4c6f-bf89-16054effc32a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:39.140333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8ea3a7d2-6221-4c6f-bf89-16054effc32a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:39.146995 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8ea3a7d2-6221-4c6f-bf89-16054effc32a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:39.147412 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8ea3a7d2-6221-4c6f-bf89-16054effc32a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:39.148268 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8ea3a7d2-6221-4c6f-bf89-16054effc32a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:39.148692 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8ea3a7d2-6221-4c6f-bf89-16054effc32a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:39.387774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8ea3a7d2-6221-4c6f-bf89-16054effc32a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:39.394883 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-35f6eb6b-69e5-4607-bd66-d6e4b32a017e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:39.395556 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-35f6eb6b-69e5-4607-bd66-d6e4b32a017e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:39.398342 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8ea3a7d2-6221-4c6f-bf89-16054effc32a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1750 microversion: 2.1 time: 0.262557 Jun 04 18:34:39.398926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 244/509] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:39 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1750 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:39.402051 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35f6eb6b-69e5-4607-bd66-d6e4b32a017e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:39.402597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35f6eb6b-69e5-4607-bd66-d6e4b32a017e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:39.403506 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35f6eb6b-69e5-4607-bd66-d6e4b32a017e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:39.403982 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35f6eb6b-69e5-4607-bd66-d6e4b32a017e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:39.543351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-35f6eb6b-69e5-4607-bd66-d6e4b32a017e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:39.551880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-35f6eb6b-69e5-4607-bd66-d6e4b32a017e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.161645 Jun 04 18:34:39.552898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 266/510] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:39 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:34:40.418968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-37a14018-95a7-4e10-abc9-90829628cd2a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:40.419586 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-37a14018-95a7-4e10-abc9-90829628cd2a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:40.426798 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37a14018-95a7-4e10-abc9-90829628cd2a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:40.427244 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37a14018-95a7-4e10-abc9-90829628cd2a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:40.428030 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37a14018-95a7-4e10-abc9-90829628cd2a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:40.428468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37a14018-95a7-4e10-abc9-90829628cd2a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:40.581819 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-37a14018-95a7-4e10-abc9-90829628cd2a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:40.589778 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-37a14018-95a7-4e10-abc9-90829628cd2a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.174751 Jun 04 18:34:40.590376 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 245/511] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:40 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:40.595435 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d1abac95-e023-4f71-b276-0de42c0c6233 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:40.596182 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d1abac95-e023-4f71-b276-0de42c0c6233 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:40.602099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1abac95-e023-4f71-b276-0de42c0c6233 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:40.602542 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1abac95-e023-4f71-b276-0de42c0c6233 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:40.603288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1abac95-e023-4f71-b276-0de42c0c6233 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:40.603738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1abac95-e023-4f71-b276-0de42c0c6233 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:40.633989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-086b9c74-4263-470f-ab2d-6dee822572a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:40.635218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-086b9c74-4263-470f-ab2d-6dee822572a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:40.644665 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-086b9c74-4263-470f-ab2d-6dee822572a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:40.645108 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-086b9c74-4263-470f-ab2d-6dee822572a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:40.645924 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-086b9c74-4263-470f-ab2d-6dee822572a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:40.646354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-086b9c74-4263-470f-ab2d-6dee822572a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:40.730719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-086b9c74-4263-470f-ab2d-6dee822572a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lazy-loading 'services' on Instance uuid 84ac4261-d93e-474e-84f7-9941b02a97c3 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:34:40.741216 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d1abac95-e023-4f71-b276-0de42c0c6233 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:40.749740 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d1abac95-e023-4f71-b276-0de42c0c6233 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.158308 Jun 04 18:34:40.750316 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 246/512] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:40 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:40.809782 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-086b9c74-4263-470f-ab2d-6dee822572a8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "DELETE /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/os-volume_attachments/a702bf7b-9628-448c-9af7-7d6c35a8ecae" status: 202 len: 0 microversion: 2.1 time: 0.298265 Jun 04 18:34:40.810444 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 267/513] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:34:40 2022] DELETE /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/os-volume_attachments/a702bf7b-9628-448c-9af7-7d6c35a8ecae => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:34:41.607855 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7950daea-65e9-4b54-a89e-ea531ed8f09e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:41.608551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7950daea-65e9-4b54-a89e-ea531ed8f09e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:41.610447 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=4 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:41.616690 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7950daea-65e9-4b54-a89e-ea531ed8f09e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:41.617126 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7950daea-65e9-4b54-a89e-ea531ed8f09e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:41.617889 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7950daea-65e9-4b54-a89e-ea531ed8f09e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:41.618326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7950daea-65e9-4b54-a89e-ea531ed8f09e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:41.768286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-76f95bbd-4841-4cc2-a5a3-189159182469 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:41.769976 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-76f95bbd-4841-4cc2-a5a3-189159182469 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:41.774078 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7950daea-65e9-4b54-a89e-ea531ed8f09e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:41.777614 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-76f95bbd-4841-4cc2-a5a3-189159182469 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:41.778544 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-76f95bbd-4841-4cc2-a5a3-189159182469 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:41.779726 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-76f95bbd-4841-4cc2-a5a3-189159182469 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:41.780506 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-76f95bbd-4841-4cc2-a5a3-189159182469 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:41.789792 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7950daea-65e9-4b54-a89e-ea531ed8f09e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.185840 Jun 04 18:34:41.790383 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 247/514] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:41 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:41.922409 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-76f95bbd-4841-4cc2-a5a3-189159182469 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:41.928425 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8de51c08-5386-4383-8746-9b398b43a99d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:34:41.931038 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-76f95bbd-4841-4cc2-a5a3-189159182469 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.167882 Jun 04 18:34:41.931611 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 268/515] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:41 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:34:41.937179 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8de51c08-5386-4383-8746-9b398b43a99d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:41.937625 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8de51c08-5386-4383-8746-9b398b43a99d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:41.963916 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8de51c08-5386-4383-8746-9b398b43a99d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Going to try to stop instance {{(pid=117731) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 18:34:42.014532 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8de51c08-5386-4383-8746-9b398b43a99d tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/action" status: 202 len: 0 microversion: 2.1 time: 0.091753 Jun 04 18:34:42.015136 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 248/516] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:34:41 2022] POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:34:42.027917 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-686e2bd3-17c6-4fc1-a0cd-ec8c44ba2484 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:42.028605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-686e2bd3-17c6-4fc1-a0cd-ec8c44ba2484 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:42.036619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-686e2bd3-17c6-4fc1-a0cd-ec8c44ba2484 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:42.037082 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-686e2bd3-17c6-4fc1-a0cd-ec8c44ba2484 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:42.037847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-686e2bd3-17c6-4fc1-a0cd-ec8c44ba2484 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:42.038319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-686e2bd3-17c6-4fc1-a0cd-ec8c44ba2484 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:42.181019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-686e2bd3-17c6-4fc1-a0cd-ec8c44ba2484 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:42.190003 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-686e2bd3-17c6-4fc1-a0cd-ec8c44ba2484 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.169889 Jun 04 18:34:42.191164 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 269/517] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:42 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:42.813392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2cad3aec-3aad-4b46-9c7d-7d628e57ad4c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:42.814518 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2cad3aec-3aad-4b46-9c7d-7d628e57ad4c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:42.821610 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2cad3aec-3aad-4b46-9c7d-7d628e57ad4c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:42.822054 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2cad3aec-3aad-4b46-9c7d-7d628e57ad4c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:42.822811 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2cad3aec-3aad-4b46-9c7d-7d628e57ad4c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:42.823240 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2cad3aec-3aad-4b46-9c7d-7d628e57ad4c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:42.949237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f235a9db-5289-4638-864c-a5a3cd4007c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:42.949831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f235a9db-5289-4638-864c-a5a3cd4007c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:42.956884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f235a9db-5289-4638-864c-a5a3cd4007c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:42.957335 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f235a9db-5289-4638-864c-a5a3cd4007c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:42.958107 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f235a9db-5289-4638-864c-a5a3cd4007c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:42.958540 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f235a9db-5289-4638-864c-a5a3cd4007c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:42.975176 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2cad3aec-3aad-4b46-9c7d-7d628e57ad4c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:42.983588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2cad3aec-3aad-4b46-9c7d-7d628e57ad4c tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.178779 Jun 04 18:34:42.984177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 249/518] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:42 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:43.099476 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f235a9db-5289-4638-864c-a5a3cd4007c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:43.107739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f235a9db-5289-4638-864c-a5a3cd4007c1 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.162547 Jun 04 18:34:43.108311 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 270/519] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:42 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:43.209141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bcb00cb5-fa16-47b2-9e49-d89f16eaf7a0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:43.209754 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bcb00cb5-fa16-47b2-9e49-d89f16eaf7a0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:43.216392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bcb00cb5-fa16-47b2-9e49-d89f16eaf7a0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:43.216857 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bcb00cb5-fa16-47b2-9e49-d89f16eaf7a0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:43.217619 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bcb00cb5-fa16-47b2-9e49-d89f16eaf7a0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:43.218061 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bcb00cb5-fa16-47b2-9e49-d89f16eaf7a0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:43.354515 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bcb00cb5-fa16-47b2-9e49-d89f16eaf7a0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:43.365460 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bcb00cb5-fa16-47b2-9e49-d89f16eaf7a0 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.160138 Jun 04 18:34:43.366203 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 250/520] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:43 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:44.001384 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f079d694-d6a2-4a6c-b3ae-3af287085cb6 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:44.001995 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f079d694-d6a2-4a6c-b3ae-3af287085cb6 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:44.009430 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f079d694-d6a2-4a6c-b3ae-3af287085cb6 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:44.009884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f079d694-d6a2-4a6c-b3ae-3af287085cb6 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:44.010651 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f079d694-d6a2-4a6c-b3ae-3af287085cb6 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:44.011086 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f079d694-d6a2-4a6c-b3ae-3af287085cb6 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:44.126214 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2e74023c-81e2-4a3a-a5b6-4da2225bb5d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:44.126795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2e74023c-81e2-4a3a-a5b6-4da2225bb5d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:44.133589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e74023c-81e2-4a3a-a5b6-4da2225bb5d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:44.134037 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e74023c-81e2-4a3a-a5b6-4da2225bb5d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:44.134796 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e74023c-81e2-4a3a-a5b6-4da2225bb5d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:44.135224 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e74023c-81e2-4a3a-a5b6-4da2225bb5d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:44.168543 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f079d694-d6a2-4a6c-b3ae-3af287085cb6 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:44.177602 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f079d694-d6a2-4a6c-b3ae-3af287085cb6 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.180049 Jun 04 18:34:44.178180 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 271/521] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:43 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:44.269804 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2e74023c-81e2-4a3a-a5b6-4da2225bb5d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:44.278152 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2e74023c-81e2-4a3a-a5b6-4da2225bb5d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.155842 Jun 04 18:34:44.278722 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 251/522] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:44 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:44.388047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-14574415-c26b-4f9e-9301-6d60a432d775 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:44.388830 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-14574415-c26b-4f9e-9301-6d60a432d775 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:44.396471 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14574415-c26b-4f9e-9301-6d60a432d775 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:44.397001 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14574415-c26b-4f9e-9301-6d60a432d775 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:44.397887 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14574415-c26b-4f9e-9301-6d60a432d775 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:44.398396 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14574415-c26b-4f9e-9301-6d60a432d775 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:44.545347 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-14574415-c26b-4f9e-9301-6d60a432d775 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:44.553381 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-14574415-c26b-4f9e-9301-6d60a432d775 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.169953 Jun 04 18:34:44.553970 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 272/523] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:44 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:45.197695 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2893edfd-4967-4c9a-8e3c-bcfdb1138f6a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:45.198647 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2893edfd-4967-4c9a-8e3c-bcfdb1138f6a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:45.207442 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2893edfd-4967-4c9a-8e3c-bcfdb1138f6a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:45.207895 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2893edfd-4967-4c9a-8e3c-bcfdb1138f6a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:45.208734 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2893edfd-4967-4c9a-8e3c-bcfdb1138f6a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:45.209170 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2893edfd-4967-4c9a-8e3c-bcfdb1138f6a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:45.296473 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-84920419-3f0c-4f4d-8211-e0d9503c7fb5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:45.296846 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-84920419-3f0c-4f4d-8211-e0d9503c7fb5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:45.304039 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84920419-3f0c-4f4d-8211-e0d9503c7fb5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:45.304832 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84920419-3f0c-4f4d-8211-e0d9503c7fb5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:45.305616 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84920419-3f0c-4f4d-8211-e0d9503c7fb5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:45.306015 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84920419-3f0c-4f4d-8211-e0d9503c7fb5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:45.330318 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:45.371882 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2893edfd-4967-4c9a-8e3c-bcfdb1138f6a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:45.380281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2893edfd-4967-4c9a-8e3c-bcfdb1138f6a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.189058 Jun 04 18:34:45.380850 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 252/524] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:45 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:45.443178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84920419-3f0c-4f4d-8211-e0d9503c7fb5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:45.451535 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-84920419-3f0c-4f4d-8211-e0d9503c7fb5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.159540 Jun 04 18:34:45.452097 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 273/525] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:45 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:45.575137 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-007c77ff-12c2-4018-97a0-33d16150d1e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:45.576124 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-007c77ff-12c2-4018-97a0-33d16150d1e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:45.587045 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-007c77ff-12c2-4018-97a0-33d16150d1e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:45.587794 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-007c77ff-12c2-4018-97a0-33d16150d1e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:45.589105 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-007c77ff-12c2-4018-97a0-33d16150d1e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:45.589828 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-007c77ff-12c2-4018-97a0-33d16150d1e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:45.728991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-007c77ff-12c2-4018-97a0-33d16150d1e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:45.736976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-007c77ff-12c2-4018-97a0-33d16150d1e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.168686 Jun 04 18:34:45.737571 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 253/526] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:45 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:46.402196 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-774fb796-c65d-4162-b724-ee93eb5eb26a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:46.403088 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-774fb796-c65d-4162-b724-ee93eb5eb26a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:46.412800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-774fb796-c65d-4162-b724-ee93eb5eb26a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:46.413249 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-774fb796-c65d-4162-b724-ee93eb5eb26a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:46.414011 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-774fb796-c65d-4162-b724-ee93eb5eb26a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:46.414480 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-774fb796-c65d-4162-b724-ee93eb5eb26a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:46.469716 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e695f083-df74-4fc6-93af-19097bb43753 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:46.470307 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e695f083-df74-4fc6-93af-19097bb43753 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:46.477197 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e695f083-df74-4fc6-93af-19097bb43753 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:46.477650 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e695f083-df74-4fc6-93af-19097bb43753 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:46.478424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e695f083-df74-4fc6-93af-19097bb43753 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:46.478860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e695f083-df74-4fc6-93af-19097bb43753 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:46.569710 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-774fb796-c65d-4162-b724-ee93eb5eb26a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:46.578507 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-774fb796-c65d-4162-b724-ee93eb5eb26a tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.182836 Jun 04 18:34:46.579095 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 274/527] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:46 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:46.754887 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-257d7967-6954-4c1d-b996-aa89ab07ecc4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:46.755539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-257d7967-6954-4c1d-b996-aa89ab07ecc4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:46.762446 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-257d7967-6954-4c1d-b996-aa89ab07ecc4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:46.762876 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-257d7967-6954-4c1d-b996-aa89ab07ecc4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:46.763722 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-257d7967-6954-4c1d-b996-aa89ab07ecc4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:46.764189 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-257d7967-6954-4c1d-b996-aa89ab07ecc4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:46.851190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e695f083-df74-4fc6-93af-19097bb43753 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:46.859435 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e695f083-df74-4fc6-93af-19097bb43753 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.393674 Jun 04 18:34:46.859969 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 254/528] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:46 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:34:46.898096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-257d7967-6954-4c1d-b996-aa89ab07ecc4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:46.906126 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-257d7967-6954-4c1d-b996-aa89ab07ecc4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.155392 Jun 04 18:34:46.906703 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 275/529] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:46 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:47.601238 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-410ca0aa-c5a0-4392-8fd9-db2da1b7d969 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:47.602625 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-410ca0aa-c5a0-4392-8fd9-db2da1b7d969 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:47.614197 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-410ca0aa-c5a0-4392-8fd9-db2da1b7d969 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:47.614641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-410ca0aa-c5a0-4392-8fd9-db2da1b7d969 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:47.615412 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-410ca0aa-c5a0-4392-8fd9-db2da1b7d969 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:47.615837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-410ca0aa-c5a0-4392-8fd9-db2da1b7d969 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:47.772511 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-410ca0aa-c5a0-4392-8fd9-db2da1b7d969 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:47.784980 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-410ca0aa-c5a0-4392-8fd9-db2da1b7d969 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.191060 Jun 04 18:34:47.785902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 255/530] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:47 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:47.881613 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e59feb07-8ce0-45a2-b40b-8d8b1381d8d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:47.882441 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e59feb07-8ce0-45a2-b40b-8d8b1381d8d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:47.893615 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e59feb07-8ce0-45a2-b40b-8d8b1381d8d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:47.894442 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e59feb07-8ce0-45a2-b40b-8d8b1381d8d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:47.895753 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e59feb07-8ce0-45a2-b40b-8d8b1381d8d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:47.896521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e59feb07-8ce0-45a2-b40b-8d8b1381d8d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:47.927136 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9e17fe2f-d089-4c52-aa65-1582b8a47e8c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:47.928084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9e17fe2f-d089-4c52-aa65-1582b8a47e8c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:47.939419 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9e17fe2f-d089-4c52-aa65-1582b8a47e8c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:47.940513 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9e17fe2f-d089-4c52-aa65-1582b8a47e8c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:47.941593 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9e17fe2f-d089-4c52-aa65-1582b8a47e8c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:47.942269 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9e17fe2f-d089-4c52-aa65-1582b8a47e8c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:48.043268 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e59feb07-8ce0-45a2-b40b-8d8b1381d8d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:48.051614 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e59feb07-8ce0-45a2-b40b-8d8b1381d8d3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.176893 Jun 04 18:34:48.052184 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 276/531] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:47 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:48.093103 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9e17fe2f-d089-4c52-aa65-1582b8a47e8c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:48.101230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9e17fe2f-d089-4c52-aa65-1582b8a47e8c tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.181491 Jun 04 18:34:48.101792 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 256/532] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:47 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:48.807252 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-eda659cc-5170-4552-9fc1-b7711c2f007e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:48.808095 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-eda659cc-5170-4552-9fc1-b7711c2f007e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:48.817567 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eda659cc-5170-4552-9fc1-b7711c2f007e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:48.818022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eda659cc-5170-4552-9fc1-b7711c2f007e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:48.818786 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eda659cc-5170-4552-9fc1-b7711c2f007e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:48.819227 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eda659cc-5170-4552-9fc1-b7711c2f007e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:48.975867 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eda659cc-5170-4552-9fc1-b7711c2f007e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:48.988666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-eda659cc-5170-4552-9fc1-b7711c2f007e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.188097 Jun 04 18:34:48.989235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 277/533] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:48 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:49.073808 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-28100305-0856-4542-b842-9cf44c3f6039 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:49.074613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-28100305-0856-4542-b842-9cf44c3f6039 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:49.083877 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28100305-0856-4542-b842-9cf44c3f6039 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:49.084355 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28100305-0856-4542-b842-9cf44c3f6039 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:49.085113 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28100305-0856-4542-b842-9cf44c3f6039 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:49.085535 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28100305-0856-4542-b842-9cf44c3f6039 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:49.103895 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:49.118696 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d7456861-b3b8-4ed3-91d6-91daa3dbddf9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:49.119270 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d7456861-b3b8-4ed3-91d6-91daa3dbddf9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:49.126222 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7456861-b3b8-4ed3-91d6-91daa3dbddf9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:49.126696 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7456861-b3b8-4ed3-91d6-91daa3dbddf9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:49.127464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7456861-b3b8-4ed3-91d6-91daa3dbddf9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:49.127991 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7456861-b3b8-4ed3-91d6-91daa3dbddf9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:49.219888 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-28100305-0856-4542-b842-9cf44c3f6039 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:49.230190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-28100305-0856-4542-b842-9cf44c3f6039 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.163589 Jun 04 18:34:49.231009 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 257/534] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:49 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:49.261026 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d7456861-b3b8-4ed3-91d6-91daa3dbddf9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:49.268855 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d7456861-b3b8-4ed3-91d6-91daa3dbddf9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.154208 Jun 04 18:34:49.269418 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 278/535] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:49 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:50.012500 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d2649b15-34ab-4183-874c-f9094dab8d95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:50.013936 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d2649b15-34ab-4183-874c-f9094dab8d95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:50.025305 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2649b15-34ab-4183-874c-f9094dab8d95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:50.025776 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2649b15-34ab-4183-874c-f9094dab8d95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:50.026588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2649b15-34ab-4183-874c-f9094dab8d95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:50.027026 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2649b15-34ab-4183-874c-f9094dab8d95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:50.193398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d2649b15-34ab-4183-874c-f9094dab8d95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:50.201812 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d2649b15-34ab-4183-874c-f9094dab8d95 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.198399 Jun 04 18:34:50.202356 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 258/536] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:50 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:50.246887 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a4baa842-fbd5-4479-a392-0f1fac26aa4e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:50.247507 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a4baa842-fbd5-4479-a392-0f1fac26aa4e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:50.254716 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a4baa842-fbd5-4479-a392-0f1fac26aa4e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:50.255167 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a4baa842-fbd5-4479-a392-0f1fac26aa4e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:50.255944 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a4baa842-fbd5-4479-a392-0f1fac26aa4e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:50.256428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a4baa842-fbd5-4479-a392-0f1fac26aa4e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:50.286929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1bcfe7c1-65c4-43cc-8bf0-03906166c6c4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:50.287535 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1bcfe7c1-65c4-43cc-8bf0-03906166c6c4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:50.294205 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1bcfe7c1-65c4-43cc-8bf0-03906166c6c4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:50.294653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1bcfe7c1-65c4-43cc-8bf0-03906166c6c4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:50.295556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1bcfe7c1-65c4-43cc-8bf0-03906166c6c4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:50.296222 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1bcfe7c1-65c4-43cc-8bf0-03906166c6c4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:50.392818 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a4baa842-fbd5-4479-a392-0f1fac26aa4e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:50.402062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a4baa842-fbd5-4479-a392-0f1fac26aa4e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.159058 Jun 04 18:34:50.402638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 279/537] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:50 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:50.428601 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1bcfe7c1-65c4-43cc-8bf0-03906166c6c4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:50.436249 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1bcfe7c1-65c4-43cc-8bf0-03906166c6c4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.153805 Jun 04 18:34:50.436809 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 259/538] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:50 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:51.224891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d6db3b68-8919-4dc5-96af-4c73e90ca112 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:51.225937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d6db3b68-8919-4dc5-96af-4c73e90ca112 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:51.236286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d6db3b68-8919-4dc5-96af-4c73e90ca112 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:51.237034 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d6db3b68-8919-4dc5-96af-4c73e90ca112 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:51.238419 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d6db3b68-8919-4dc5-96af-4c73e90ca112 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:51.238817 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d6db3b68-8919-4dc5-96af-4c73e90ca112 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:51.395361 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d6db3b68-8919-4dc5-96af-4c73e90ca112 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:51.403873 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d6db3b68-8919-4dc5-96af-4c73e90ca112 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.187437 Jun 04 18:34:51.404473 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 280/539] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:51 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:51.423324 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c2090217-5c3b-409c-b7fa-4f1db201e664 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:51.423972 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c2090217-5c3b-409c-b7fa-4f1db201e664 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:51.431297 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c2090217-5c3b-409c-b7fa-4f1db201e664 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:51.431756 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c2090217-5c3b-409c-b7fa-4f1db201e664 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:51.432574 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c2090217-5c3b-409c-b7fa-4f1db201e664 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:51.433016 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c2090217-5c3b-409c-b7fa-4f1db201e664 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:51.453615 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e325114a-ce26-4182-9aad-f6258f56e767 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:51.454187 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e325114a-ce26-4182-9aad-f6258f56e767 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:51.461075 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e325114a-ce26-4182-9aad-f6258f56e767 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:51.461500 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e325114a-ce26-4182-9aad-f6258f56e767 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:51.462264 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e325114a-ce26-4182-9aad-f6258f56e767 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:51.462701 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e325114a-ce26-4182-9aad-f6258f56e767 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:51.570478 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c2090217-5c3b-409c-b7fa-4f1db201e664 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:51.578870 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c2090217-5c3b-409c-b7fa-4f1db201e664 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.161770 Jun 04 18:34:51.579444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 260/540] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:51 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:51.597579 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e325114a-ce26-4182-9aad-f6258f56e767 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:51.605520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e325114a-ce26-4182-9aad-f6258f56e767 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.155898 Jun 04 18:34:51.606073 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 281/541] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:51 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:52.424234 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-575146da-6435-4426-936e-4b2234a6cb75 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:52.425080 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-575146da-6435-4426-936e-4b2234a6cb75 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:52.434182 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-575146da-6435-4426-936e-4b2234a6cb75 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:52.434713 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-575146da-6435-4426-936e-4b2234a6cb75 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:52.435470 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-575146da-6435-4426-936e-4b2234a6cb75 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:52.435902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-575146da-6435-4426-936e-4b2234a6cb75 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:52.581775 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-575146da-6435-4426-936e-4b2234a6cb75 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:52.593814 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-575146da-6435-4426-936e-4b2234a6cb75 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.175182 Jun 04 18:34:52.594606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 261/542] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:52 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:52.598536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-455068ad-faa9-4c1f-b5c8-edbb1d3c107c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:52.599137 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-455068ad-faa9-4c1f-b5c8-edbb1d3c107c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:52.605768 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-455068ad-faa9-4c1f-b5c8-edbb1d3c107c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:52.606217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-455068ad-faa9-4c1f-b5c8-edbb1d3c107c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:52.606972 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-455068ad-faa9-4c1f-b5c8-edbb1d3c107c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:52.607400 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-455068ad-faa9-4c1f-b5c8-edbb1d3c107c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:52.622591 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2e226770-7491-4081-8af2-e99e209ca1a6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:52.623295 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2e226770-7491-4081-8af2-e99e209ca1a6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:52.629548 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e226770-7491-4081-8af2-e99e209ca1a6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:52.630009 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e226770-7491-4081-8af2-e99e209ca1a6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:52.630780 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e226770-7491-4081-8af2-e99e209ca1a6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:52.631222 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e226770-7491-4081-8af2-e99e209ca1a6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:52.739314 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-455068ad-faa9-4c1f-b5c8-edbb1d3c107c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:52.748312 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-455068ad-faa9-4c1f-b5c8-edbb1d3c107c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.155591 Jun 04 18:34:52.748901 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 282/543] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:52 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:52.761006 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2e226770-7491-4081-8af2-e99e209ca1a6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:52.769678 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2e226770-7491-4081-8af2-e99e209ca1a6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.150904 Jun 04 18:34:52.770250 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 262/544] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:52 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:53.614450 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5fc68641-197b-4cbf-ab89-288b4408986d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:53.615109 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5fc68641-197b-4cbf-ab89-288b4408986d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:53.623172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5fc68641-197b-4cbf-ab89-288b4408986d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:53.623714 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5fc68641-197b-4cbf-ab89-288b4408986d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:53.624761 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5fc68641-197b-4cbf-ab89-288b4408986d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:53.625291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5fc68641-197b-4cbf-ab89-288b4408986d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:53.766840 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f38666d4-6553-4edc-b8d6-76f270b73b67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:53.767436 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f38666d4-6553-4edc-b8d6-76f270b73b67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:53.774949 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f38666d4-6553-4edc-b8d6-76f270b73b67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:53.775394 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f38666d4-6553-4edc-b8d6-76f270b73b67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:53.776203 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f38666d4-6553-4edc-b8d6-76f270b73b67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:53.776628 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f38666d4-6553-4edc-b8d6-76f270b73b67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:53.781259 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5fc68641-197b-4cbf-ab89-288b4408986d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:53.790371 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5fc68641-197b-4cbf-ab89-288b4408986d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.181534 Jun 04 18:34:53.791024 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 283/545] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:53 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:53.795505 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a53ba1a4-486d-4589-91bc-f4a92da22539 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:53.796128 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a53ba1a4-486d-4589-91bc-f4a92da22539 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:53.802327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a53ba1a4-486d-4589-91bc-f4a92da22539 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:53.802774 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a53ba1a4-486d-4589-91bc-f4a92da22539 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:53.803878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a53ba1a4-486d-4589-91bc-f4a92da22539 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:53.804347 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a53ba1a4-486d-4589-91bc-f4a92da22539 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:53.911606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f38666d4-6553-4edc-b8d6-76f270b73b67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:53.919768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f38666d4-6553-4edc-b8d6-76f270b73b67 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.156861 Jun 04 18:34:53.920434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 263/546] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:53 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:53.936167 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a53ba1a4-486d-4589-91bc-f4a92da22539 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:53.944686 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a53ba1a4-486d-4589-91bc-f4a92da22539 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.152719 Jun 04 18:34:53.945256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 284/547] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:53 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:54.667022 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-226630940", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-493393868", "security_groups": [{"name": "tempest-secgroup-smoke-1787165407"}], "block_device_mapping_v2": [{"uuid": "76297bf4-cceb-46ae-bcbd-2c80c798884e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9fe7d892-020a-4605-a021-7aea70be8ad6"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:34:54.790112 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] validate_networks() for [('9fe7d892-020a-4605-a021-7aea70be8ad6', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:34:54.808909 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1a4f3c36-6118-44ce-86ea-10dbb6ea5142 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:54.809492 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1a4f3c36-6118-44ce-86ea-10dbb6ea5142 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:54.817273 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a4f3c36-6118-44ce-86ea-10dbb6ea5142 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:54.817720 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a4f3c36-6118-44ce-86ea-10dbb6ea5142 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:54.818516 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a4f3c36-6118-44ce-86ea-10dbb6ea5142 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:54.818948 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a4f3c36-6118-44ce-86ea-10dbb6ea5142 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:54.968189 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1a4f3c36-6118-44ce-86ea-10dbb6ea5142 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:54.976455 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1a4f3c36-6118-44ce-86ea-10dbb6ea5142 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1755 microversion: 2.1 time: 0.171760 Jun 04 18:34:54.977140 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 285/548] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:54 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:54.981545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d4774e11-6cc5-41de-9144-5b3545b272af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:54.982319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d4774e11-6cc5-41de-9144-5b3545b272af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:54.988641 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4774e11-6cc5-41de-9144-5b3545b272af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:54.989116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4774e11-6cc5-41de-9144-5b3545b272af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:54.989877 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4774e11-6cc5-41de-9144-5b3545b272af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:54.990343 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4774e11-6cc5-41de-9144-5b3545b272af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:55.127890 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4774e11-6cc5-41de-9144-5b3545b272af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:55.136855 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d4774e11-6cc5-41de-9144-5b3545b272af tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.158687 Jun 04 18:34:55.137430 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 286/549] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:54 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:55.142620 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9f59f0ed-0b03-4074-92ca-4adbe97f3197 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:55.143415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9f59f0ed-0b03-4074-92ca-4adbe97f3197 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:55.149846 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f59f0ed-0b03-4074-92ca-4adbe97f3197 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:55.150303 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f59f0ed-0b03-4074-92ca-4adbe97f3197 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:55.151263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f59f0ed-0b03-4074-92ca-4adbe97f3197 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:55.151702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f59f0ed-0b03-4074-92ca-4adbe97f3197 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:55.256537 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:34:55.257102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:34:55.257579 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:34:55.257985 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:34:55.258391 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:34:55.268335 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:55.268779 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:55.269705 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:55.270153 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:55.281472 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9f59f0ed-0b03-4074-92ca-4adbe97f3197 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:55.289010 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Getting quotas for project 2829dcddd2864698b273038b8df5ce76. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:34:55.289808 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9f59f0ed-0b03-4074-92ca-4adbe97f3197 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.151165 Jun 04 18:34:55.290382 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 287/550] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:55 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:55.293395 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Getting quotas for user cf94c76ba04b403b91a7ff77a2f476e8 and project 2829dcddd2864698b273038b8df5ce76. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:34:55.351989 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:34:55.354182 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76297bf4-cceb-46ae-bcbd-2c80c798884e',volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:34:55.508175 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a36ddbc5-655c-4d89-a9b3-16a5792bd548 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.847442 Jun 04 18:34:55.508796 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 264/551] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:34:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:34:55.518819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8a0e8c3c-c95d-42ff-879f-0f3495c3a064 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:55.519512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8a0e8c3c-c95d-42ff-879f-0f3495c3a064 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:55.573583 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8a0e8c3c-c95d-42ff-879f-0f3495c3a064 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:55.580232 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8a0e8c3c-c95d-42ff-879f-0f3495c3a064 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1093 microversion: 2.1 time: 0.065315 Jun 04 18:34:55.580789 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 288/552] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:55 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:55.998155 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3bb89fd6-7552-4c51-b565-92a07ad4239e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:55.999096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3bb89fd6-7552-4c51-b565-92a07ad4239e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:56.008269 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bb89fd6-7552-4c51-b565-92a07ad4239e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:56.008715 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bb89fd6-7552-4c51-b565-92a07ad4239e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:56.009511 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bb89fd6-7552-4c51-b565-92a07ad4239e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:56.009974 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bb89fd6-7552-4c51-b565-92a07ad4239e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:56.155099 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7423201c-4dfb-4132-ae13-bb788d25aa91 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:56.155855 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7423201c-4dfb-4132-ae13-bb788d25aa91 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:56.165388 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7423201c-4dfb-4132-ae13-bb788d25aa91 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:56.166019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7423201c-4dfb-4132-ae13-bb788d25aa91 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:56.167472 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7423201c-4dfb-4132-ae13-bb788d25aa91 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:56.167911 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7423201c-4dfb-4132-ae13-bb788d25aa91 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:56.218515 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3bb89fd6-7552-4c51-b565-92a07ad4239e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:56.227114 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3bb89fd6-7552-4c51-b565-92a07ad4239e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1758 microversion: 2.1 time: 0.235782 Jun 04 18:34:56.227690 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 265/553] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:55 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1758 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:56.315864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fd7362ce-4de5-4643-ae0c-4a92adf444c5 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:56.316584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fd7362ce-4de5-4643-ae0c-4a92adf444c5 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:56.324070 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd7362ce-4de5-4643-ae0c-4a92adf444c5 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:56.324369 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7423201c-4dfb-4132-ae13-bb788d25aa91 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:56.325037 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd7362ce-4de5-4643-ae0c-4a92adf444c5 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:56.326046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd7362ce-4de5-4643-ae0c-4a92adf444c5 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:56.326692 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd7362ce-4de5-4643-ae0c-4a92adf444c5 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:56.335702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7423201c-4dfb-4132-ae13-bb788d25aa91 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.184735 Jun 04 18:34:56.336377 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 289/554] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:56 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:56.500391 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fd7362ce-4de5-4643-ae0c-4a92adf444c5 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:56.508138 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fd7362ce-4de5-4643-ae0c-4a92adf444c5 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.198188 Jun 04 18:34:56.508735 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 266/555] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:56 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:56.603266 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d10e52f5-0ad8-48f8-9887-0267b5f148f2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:56.604583 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d10e52f5-0ad8-48f8-9887-0267b5f148f2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:56.614452 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d10e52f5-0ad8-48f8-9887-0267b5f148f2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:56.614899 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d10e52f5-0ad8-48f8-9887-0267b5f148f2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:56.615657 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d10e52f5-0ad8-48f8-9887-0267b5f148f2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:56.616111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d10e52f5-0ad8-48f8-9887-0267b5f148f2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:56.685320 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d10e52f5-0ad8-48f8-9887-0267b5f148f2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:56.698119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d10e52f5-0ad8-48f8-9887-0267b5f148f2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1191 microversion: 2.1 time: 0.102447 Jun 04 18:34:56.699144 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 290/556] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:56 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:57.353600 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-31ec60ef-241d-4623-9d4e-d50d89a92c84 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:57.354220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-31ec60ef-241d-4623-9d4e-d50d89a92c84 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:57.361028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-31ec60ef-241d-4623-9d4e-d50d89a92c84 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:57.361491 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-31ec60ef-241d-4623-9d4e-d50d89a92c84 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:57.362339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-31ec60ef-241d-4623-9d4e-d50d89a92c84 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:57.362778 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-31ec60ef-241d-4623-9d4e-d50d89a92c84 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:57.525709 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-477526be-fd64-451e-a0da-55270f807158 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:57.526260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-477526be-fd64-451e-a0da-55270f807158 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:57.528644 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=61 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:57.534161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-477526be-fd64-451e-a0da-55270f807158 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:57.534619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-477526be-fd64-451e-a0da-55270f807158 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:57.535784 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-477526be-fd64-451e-a0da-55270f807158 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:57.536243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-477526be-fd64-451e-a0da-55270f807158 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:57.540975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:57.564807 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-31ec60ef-241d-4623-9d4e-d50d89a92c84 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:57.574472 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-31ec60ef-241d-4623-9d4e-d50d89a92c84 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.224787 Jun 04 18:34:57.575463 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 267/557] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:57 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:34:57.676940 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-477526be-fd64-451e-a0da-55270f807158 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:57.685851 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-477526be-fd64-451e-a0da-55270f807158 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.164071 Jun 04 18:34:57.687067 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 291/558] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:57 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:57.714957 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-37d2c9c9-52c4-4542-8734-3ab7613e4fba tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:57.715567 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-37d2c9c9-52c4-4542-8734-3ab7613e4fba tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:57.728627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37d2c9c9-52c4-4542-8734-3ab7613e4fba tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:57.729229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37d2c9c9-52c4-4542-8734-3ab7613e4fba tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:57.730384 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37d2c9c9-52c4-4542-8734-3ab7613e4fba tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:57.731060 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37d2c9c9-52c4-4542-8734-3ab7613e4fba tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:57.865436 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-37d2c9c9-52c4-4542-8734-3ab7613e4fba tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:57.873082 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-37d2c9c9-52c4-4542-8734-3ab7613e4fba tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1277 microversion: 2.1 time: 0.161989 Jun 04 18:34:57.873650 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 268/559] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:57 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:58.597481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c02447ec-ea8b-485d-8260-957799885406 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:58.600383 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c02447ec-ea8b-485d-8260-957799885406 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:58.610838 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c02447ec-ea8b-485d-8260-957799885406 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:58.611595 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c02447ec-ea8b-485d-8260-957799885406 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:58.612932 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c02447ec-ea8b-485d-8260-957799885406 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:58.613718 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c02447ec-ea8b-485d-8260-957799885406 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:58.705290 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-94897295-22ac-4ae6-832e-34c0e77484bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:58.706653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-94897295-22ac-4ae6-832e-34c0e77484bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:58.719390 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-94897295-22ac-4ae6-832e-34c0e77484bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:58.719951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-94897295-22ac-4ae6-832e-34c0e77484bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:58.721086 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-94897295-22ac-4ae6-832e-34c0e77484bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:58.721888 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-94897295-22ac-4ae6-832e-34c0e77484bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:58.773214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c02447ec-ea8b-485d-8260-957799885406 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:58.781975 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c02447ec-ea8b-485d-8260-957799885406 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.192137 Jun 04 18:34:58.782536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 292/560] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:58 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:58.894452 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-08185bdf-9170-4fa3-81c7-805139c07412 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:58.895169 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-08185bdf-9170-4fa3-81c7-805139c07412 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:58.901766 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-08185bdf-9170-4fa3-81c7-805139c07412 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:58.902219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-08185bdf-9170-4fa3-81c7-805139c07412 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:58.902992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-08185bdf-9170-4fa3-81c7-805139c07412 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:58.903430 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-08185bdf-9170-4fa3-81c7-805139c07412 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:58.975696 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-94897295-22ac-4ae6-832e-34c0e77484bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:58.983513 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-94897295-22ac-4ae6-832e-34c0e77484bc tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1676 microversion: 2.1 time: 0.282495 Jun 04 18:34:58.984660 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 269/561] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:58 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1676 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:59.063522 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-08185bdf-9170-4fa3-81c7-805139c07412 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:59.072161 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-08185bdf-9170-4fa3-81c7-805139c07412 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1277 microversion: 2.1 time: 0.181613 Jun 04 18:34:59.083443 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 293/562] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:58 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:34:59.418361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-a8aa8ac8-b8d9-4c82-b1ef-6fbee2cca424 req-b0d19920-8a59-4c3f-bf55-19ab49992a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19a4a77-7305-41d2-913c-d40b18d5d926", "tag": "579c9e95-870c-43c9-9e8c-5736b6552a27"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:34:59.427357 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a8aa8ac8-b8d9-4c82-b1ef-6fbee2cca424 req-b0d19920-8a59-4c3f-bf55-19ab49992a74 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:59.428111 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a8aa8ac8-b8d9-4c82-b1ef-6fbee2cca424 req-b0d19920-8a59-4c3f-bf55-19ab49992a74 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:59.441583 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-a8aa8ac8-b8d9-4c82-b1ef-6fbee2cca424 req-b0d19920-8a59-4c3f-bf55-19ab49992a74 service nova] Creating event network-changed:579c9e95-870c-43c9-9e8c-5736b6552a27 for instance e19a4a77-7305-41d2-913c-d40b18d5d926 on hv-cinder-79053 Jun 04 18:34:59.447601 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-a8aa8ac8-b8d9-4c82-b1ef-6fbee2cca424 req-b0d19920-8a59-4c3f-bf55-19ab49992a74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032989 Jun 04 18:34:59.448342 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 270/563] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:34:59.800571 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cc50c3a4-9d95-4104-8df5-74916b05081d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:34:59.801158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cc50c3a4-9d95-4104-8df5-74916b05081d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:34:59.809132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc50c3a4-9d95-4104-8df5-74916b05081d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:59.809589 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc50c3a4-9d95-4104-8df5-74916b05081d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:59.810899 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc50c3a4-9d95-4104-8df5-74916b05081d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:34:59.811344 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc50c3a4-9d95-4104-8df5-74916b05081d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:34:59.944962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cc50c3a4-9d95-4104-8df5-74916b05081d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:34:59.953374 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cc50c3a4-9d95-4104-8df5-74916b05081d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1736 microversion: 2.1 time: 0.156705 Jun 04 18:34:59.953931 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 294/564] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:59 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:00.001559 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b26eadb9-9307-4d0e-9e79-11860ab6fac9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:00.002247 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b26eadb9-9307-4d0e-9e79-11860ab6fac9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:00.009363 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b26eadb9-9307-4d0e-9e79-11860ab6fac9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:00.009806 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b26eadb9-9307-4d0e-9e79-11860ab6fac9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:00.010555 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b26eadb9-9307-4d0e-9e79-11860ab6fac9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:00.010982 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b26eadb9-9307-4d0e-9e79-11860ab6fac9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:00.090529 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1234575c-7662-4160-a775-0f4395ce3ea2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:00.091159 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1234575c-7662-4160-a775-0f4395ce3ea2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:00.097420 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1234575c-7662-4160-a775-0f4395ce3ea2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:00.097877 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1234575c-7662-4160-a775-0f4395ce3ea2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:00.098770 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1234575c-7662-4160-a775-0f4395ce3ea2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:00.099508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1234575c-7662-4160-a775-0f4395ce3ea2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:00.155403 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b26eadb9-9307-4d0e-9e79-11860ab6fac9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:00.165097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b26eadb9-9307-4d0e-9e79-11860ab6fac9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1653 microversion: 2.1 time: 0.167806 Jun 04 18:35:00.165802 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 271/565] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:34:59 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1653 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:00.181556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9543b36a-2b6f-4cfe-a423-1a49265c8c6b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:00.189472 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9543b36a-2b6f-4cfe-a423-1a49265c8c6b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:00.189935 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9543b36a-2b6f-4cfe-a423-1a49265c8c6b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:00.215733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9543b36a-2b6f-4cfe-a423-1a49265c8c6b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Going to try to start instance {{(pid=117731) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 18:35:00.263296 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1234575c-7662-4160-a775-0f4395ce3ea2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:00.269626 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9543b36a-2b6f-4cfe-a423-1a49265c8c6b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/action" status: 202 len: 0 microversion: 2.1 time: 0.091701 Jun 04 18:35:00.270324 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 272/566] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:35:00 2022] POST /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:35:00.272501 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1234575c-7662-4160-a775-0f4395ce3ea2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.185754 Jun 04 18:35:00.276392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 295/567] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:00 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:00.280036 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-98805f8c-0686-4e26-be15-70d7dca621e2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:00.280777 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-98805f8c-0686-4e26-be15-70d7dca621e2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:00.287725 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-98805f8c-0686-4e26-be15-70d7dca621e2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:00.288868 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-98805f8c-0686-4e26-be15-70d7dca621e2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:00.289627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-98805f8c-0686-4e26-be15-70d7dca621e2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:00.290057 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-98805f8c-0686-4e26-be15-70d7dca621e2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:00.554621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-98805f8c-0686-4e26-be15-70d7dca621e2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:00.562525 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-98805f8c-0686-4e26-be15-70d7dca621e2 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1662 microversion: 2.1 time: 0.287023 Jun 04 18:35:00.563458 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 273/568] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:00 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1662 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:00.975203 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-38a96309-5618-4ece-b3cb-231ac1b1d230 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:00.975809 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-38a96309-5618-4ece-b3cb-231ac1b1d230 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:00.982260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38a96309-5618-4ece-b3cb-231ac1b1d230 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:00.982728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38a96309-5618-4ece-b3cb-231ac1b1d230 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:00.983494 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38a96309-5618-4ece-b3cb-231ac1b1d230 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:00.983930 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38a96309-5618-4ece-b3cb-231ac1b1d230 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.125146 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-38a96309-5618-4ece-b3cb-231ac1b1d230 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:01.133917 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-38a96309-5618-4ece-b3cb-231ac1b1d230 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1716 microversion: 2.1 time: 0.165677 Jun 04 18:35:01.134489 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 296/569] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:00 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:01.197217 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:01.197844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:01.200828 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:01.206277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.206826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.209609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.210061 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.230917 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:01.290393 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0e0db944-6e09-4446-b8ab-c5136a58d156 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:01.296179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0e0db944-6e09-4446-b8ab-c5136a58d156 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:01.317226 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] HTTP exception thrown: Cannot 'detach_volume' instance 989409f2-e7e3-4010-b525-e7389d3eb160 while it is in vm_state rescued Jun 04 18:35:01.317521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0e0db944-6e09-4446-b8ab-c5136a58d156 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.318121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0e0db944-6e09-4446-b8ab-c5136a58d156 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Request method failure captured: Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments/d0519c5a-05c6-4887-b2f6-9105c919d34b HTTP/1.1 Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6RqS-9onUVAQGG50nh-ykJv3ebxr_uOLOGJQQGXHZ5PcA_dRtSeaxeAuLuD9LWANPONJYjTDzvX1VgDiUyQ28PBykZ_enjmoLQV2epMvEDYXX0uhOleqqEw2dKqDYLppBBTJtYIzfeFJA9opK-PIEQeBWOWKHuFxG4JT2kOVxM-W5A Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:35:01.319042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}] Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 30f3cc8f3f964b96b864fc8a7f86481a Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:35:01.321637 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Cannot 'detach_volume' instance 989409f2-e7e3-4010-b525-e7389d3eb160 while it is in vm_state rescued Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'server_id': '989409f2-e7e3-4010-b525-e7389d3eb160', 'id': 'd0519c5a-05c6-4887-b2f6-9105c919d34b'} Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 989409f2-e7e3-4010-b525-e7389d3eb160 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:35:01.323187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 989409f2-e7e3-4010-b525-e7389d3eb160 while it is in vm_state rescued Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 989409f2-e7e3-4010-b525-e7389d3eb160 while it is in vm_state rescued Jun 04 18:35:01.326674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:35:01.329743 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0e0db944-6e09-4446-b8ab-c5136a58d156 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.329986 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Returning 409 to user: Cannot 'detach_volume' instance 989409f2-e7e3-4010-b525-e7389d3eb160 while it is in vm_state rescued {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:35:01.330228 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0e0db944-6e09-4446-b8ab-c5136a58d156 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.330468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-397ea08a-85e9-43a0-93e2-359cfc5c87c3 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments/d0519c5a-05c6-4887-b2f6-9105c919d34b" status: 409 len: 152 microversion: 2.1 time: 0.128685 Jun 04 18:35:01.330468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 274/570] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:35:01 2022] DELETE /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments/d0519c5a-05c6-4887-b2f6-9105c919d34b => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 18:35:01.330468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-63d405c2-8e7a-4e49-a955-d58842166def tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:01.330468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-63d405c2-8e7a-4e49-a955-d58842166def tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:01.337459 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63d405c2-8e7a-4e49-a955-d58842166def tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.337916 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63d405c2-8e7a-4e49-a955-d58842166def tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.338707 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63d405c2-8e7a-4e49-a955-d58842166def tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.339146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63d405c2-8e7a-4e49-a955-d58842166def tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.421063 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-63d405c2-8e7a-4e49-a955-d58842166def tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "POST /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/action" status: 202 len: 0 microversion: 2.1 time: 0.095110 Jun 04 18:35:01.421706 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 275/571] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:35:01 2022] POST /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 18:35:01.444285 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3d82851b-761b-482d-b085-7ab76420767c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:01.445314 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3d82851b-761b-482d-b085-7ab76420767c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:01.460402 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3d82851b-761b-482d-b085-7ab76420767c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.461190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3d82851b-761b-482d-b085-7ab76420767c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.462009 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3d82851b-761b-482d-b085-7ab76420767c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.462534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3d82851b-761b-482d-b085-7ab76420767c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.528168 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0e0db944-6e09-4446-b8ab-c5136a58d156 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:01.540505 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0e0db944-6e09-4446-b8ab-c5136a58d156 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.253983 Jun 04 18:35:01.541441 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 297/572] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:01 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:01.582851 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fb8b3f46-4d71-4b1d-97d3-dbe32ddc07c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:01.583772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fb8b3f46-4d71-4b1d-97d3-dbe32ddc07c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:01.592350 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fb8b3f46-4d71-4b1d-97d3-dbe32ddc07c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.592925 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fb8b3f46-4d71-4b1d-97d3-dbe32ddc07c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.594035 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fb8b3f46-4d71-4b1d-97d3-dbe32ddc07c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:01.594934 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fb8b3f46-4d71-4b1d-97d3-dbe32ddc07c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:01.809326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3d82851b-761b-482d-b085-7ab76420767c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:01.819459 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3d82851b-761b-482d-b085-7ab76420767c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1724 microversion: 2.1 time: 0.382663 Jun 04 18:35:01.820297 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 276/573] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:01 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:35:01.839304 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fb8b3f46-4d71-4b1d-97d3-dbe32ddc07c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:01.847251 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fb8b3f46-4d71-4b1d-97d3-dbe32ddc07c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1662 microversion: 2.1 time: 0.270213 Jun 04 18:35:01.857947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 298/574] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:01 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1662 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:02.561769 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-88423920-13d1-4405-8edf-52c407f04a95 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:02.562651 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-88423920-13d1-4405-8edf-52c407f04a95 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:02.571573 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-88423920-13d1-4405-8edf-52c407f04a95 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:02.572048 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-88423920-13d1-4405-8edf-52c407f04a95 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:02.572813 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-88423920-13d1-4405-8edf-52c407f04a95 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:02.573247 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-88423920-13d1-4405-8edf-52c407f04a95 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:02.717603 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-88423920-13d1-4405-8edf-52c407f04a95 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:02.727724 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-88423920-13d1-4405-8edf-52c407f04a95 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.172675 Jun 04 18:35:02.736835 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 277/575] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:02 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:02.837996 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1876b00c-6c0b-42b9-bf5d-e807a5c218b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:02.839233 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1876b00c-6c0b-42b9-bf5d-e807a5c218b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:02.845930 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1876b00c-6c0b-42b9-bf5d-e807a5c218b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:02.846383 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1876b00c-6c0b-42b9-bf5d-e807a5c218b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:02.847140 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1876b00c-6c0b-42b9-bf5d-e807a5c218b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:02.847589 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1876b00c-6c0b-42b9-bf5d-e807a5c218b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:02.865992 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-137d5123-1fd0-46fc-bb9f-397c025df920 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:02.866608 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-137d5123-1fd0-46fc-bb9f-397c025df920 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:02.872755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-137d5123-1fd0-46fc-bb9f-397c025df920 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:02.873237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-137d5123-1fd0-46fc-bb9f-397c025df920 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:02.874010 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-137d5123-1fd0-46fc-bb9f-397c025df920 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:02.874445 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-137d5123-1fd0-46fc-bb9f-397c025df920 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:02.987568 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1876b00c-6c0b-42b9-bf5d-e807a5c218b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:02.996391 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1876b00c-6c0b-42b9-bf5d-e807a5c218b5 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1724 microversion: 2.1 time: 0.162716 Jun 04 18:35:02.997182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 299/576] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:02 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:03.011843 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-137d5123-1fd0-46fc-bb9f-397c025df920 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:03.019768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-137d5123-1fd0-46fc-bb9f-397c025df920 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1662 microversion: 2.1 time: 0.158154 Jun 04 18:35:03.020374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 278/577] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:02 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:03.748864 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-98f30397-6680-4984-b690-810fdae4329d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:03.749838 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-98f30397-6680-4984-b690-810fdae4329d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:03.759659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-98f30397-6680-4984-b690-810fdae4329d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:03.760441 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-98f30397-6680-4984-b690-810fdae4329d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:03.761597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-98f30397-6680-4984-b690-810fdae4329d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:03.762268 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-98f30397-6680-4984-b690-810fdae4329d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:03.899867 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-98f30397-6680-4984-b690-810fdae4329d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:03.907781 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-98f30397-6680-4984-b690-810fdae4329d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.165141 Jun 04 18:35:03.908381 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 300/578] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:03 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:04.018684 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fb5ed639-9d7b-4d82-a7b1-5d5c11f4755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:04.019513 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fb5ed639-9d7b-4d82-a7b1-5d5c11f4755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:04.030745 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb5ed639-9d7b-4d82-a7b1-5d5c11f4755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:04.031496 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb5ed639-9d7b-4d82-a7b1-5d5c11f4755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:04.033936 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb5ed639-9d7b-4d82-a7b1-5d5c11f4755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:04.034543 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb5ed639-9d7b-4d82-a7b1-5d5c11f4755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:04.038881 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e0b612e9-d7a1-4166-97a2-0146da531f0e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:04.039484 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e0b612e9-d7a1-4166-97a2-0146da531f0e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:04.046127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0b612e9-d7a1-4166-97a2-0146da531f0e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:04.046742 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0b612e9-d7a1-4166-97a2-0146da531f0e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:04.047629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0b612e9-d7a1-4166-97a2-0146da531f0e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:04.048245 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0b612e9-d7a1-4166-97a2-0146da531f0e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:04.167293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fb5ed639-9d7b-4d82-a7b1-5d5c11f4755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:04.175761 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fb5ed639-9d7b-4d82-a7b1-5d5c11f4755c tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1724 microversion: 2.1 time: 0.163843 Jun 04 18:35:04.176382 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 279/579] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:04 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:04.187951 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0b612e9-d7a1-4166-97a2-0146da531f0e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:04.195927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e0b612e9-d7a1-4166-97a2-0146da531f0e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1662 microversion: 2.1 time: 0.161524 Jun 04 18:35:04.196731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 301/580] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:04 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:04.928994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-74145578-39ff-420b-84d0-8b05eb477565 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:04.930058 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-74145578-39ff-420b-84d0-8b05eb477565 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:04.940611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74145578-39ff-420b-84d0-8b05eb477565 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:04.941444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74145578-39ff-420b-84d0-8b05eb477565 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:04.942878 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74145578-39ff-420b-84d0-8b05eb477565 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:04.943509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74145578-39ff-420b-84d0-8b05eb477565 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:05.085128 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-74145578-39ff-420b-84d0-8b05eb477565 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:05.092850 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-74145578-39ff-420b-84d0-8b05eb477565 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.170433 Jun 04 18:35:05.093413 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 280/581] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:04 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:05.193482 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-39dd7b93-8420-4893-b01e-429fd140cddd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:05.194083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-39dd7b93-8420-4893-b01e-429fd140cddd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:05.200790 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-39dd7b93-8420-4893-b01e-429fd140cddd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:05.201248 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-39dd7b93-8420-4893-b01e-429fd140cddd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:05.202015 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-39dd7b93-8420-4893-b01e-429fd140cddd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:05.202452 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-39dd7b93-8420-4893-b01e-429fd140cddd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:05.214989 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-58b1e5a4-32b6-4a47-bb17-ddcc46f4ae21 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:05.215601 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-58b1e5a4-32b6-4a47-bb17-ddcc46f4ae21 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:05.221970 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-58b1e5a4-32b6-4a47-bb17-ddcc46f4ae21 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:05.222428 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-58b1e5a4-32b6-4a47-bb17-ddcc46f4ae21 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:05.223199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-58b1e5a4-32b6-4a47-bb17-ddcc46f4ae21 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:05.223636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-58b1e5a4-32b6-4a47-bb17-ddcc46f4ae21 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:05.277525 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:05.301838 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:05.343178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-39dd7b93-8420-4893-b01e-429fd140cddd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:05.351499 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-39dd7b93-8420-4893-b01e-429fd140cddd tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1724 microversion: 2.1 time: 0.161996 Jun 04 18:35:05.352092 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 302/582] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:05 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:05.361585 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-58b1e5a4-32b6-4a47-bb17-ddcc46f4ae21 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:05.370030 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-58b1e5a4-32b6-4a47-bb17-ddcc46f4ae21 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1666 microversion: 2.1 time: 0.158957 Jun 04 18:35:05.370589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 281/583] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:05 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:06.109398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-351c1f3d-dbb4-47b0-a875-11f97f2489c9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:06.110012 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-351c1f3d-dbb4-47b0-a875-11f97f2489c9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:06.111883 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:06.118126 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-351c1f3d-dbb4-47b0-a875-11f97f2489c9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:06.118577 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-351c1f3d-dbb4-47b0-a875-11f97f2489c9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:06.119344 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-351c1f3d-dbb4-47b0-a875-11f97f2489c9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:06.119776 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-351c1f3d-dbb4-47b0-a875-11f97f2489c9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:06.257574 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-351c1f3d-dbb4-47b0-a875-11f97f2489c9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:06.265781 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-351c1f3d-dbb4-47b0-a875-11f97f2489c9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.160384 Jun 04 18:35:06.266339 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 303/584] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:06 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:06.374014 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4c779675-88a6-4ca1-9684-c15f8c0dba1d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:06.375058 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4c779675-88a6-4ca1-9684-c15f8c0dba1d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:06.384446 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4c779675-88a6-4ca1-9684-c15f8c0dba1d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:06.384892 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4c779675-88a6-4ca1-9684-c15f8c0dba1d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:06.385674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4c779675-88a6-4ca1-9684-c15f8c0dba1d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:06.386107 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4c779675-88a6-4ca1-9684-c15f8c0dba1d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:06.521338 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4c779675-88a6-4ca1-9684-c15f8c0dba1d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:06.529264 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4c779675-88a6-4ca1-9684-c15f8c0dba1d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1730 microversion: 2.1 time: 0.161864 Jun 04 18:35:06.529865 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 282/585] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:06 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:06.548981 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-70de8d83-463c-4728-b774-080e11b9f874 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:06.549532 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-70de8d83-463c-4728-b774-080e11b9f874 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:06.558540 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-70de8d83-463c-4728-b774-080e11b9f874 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:06.559096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-70de8d83-463c-4728-b774-080e11b9f874 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:06.560255 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-70de8d83-463c-4728-b774-080e11b9f874 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:06.560821 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-70de8d83-463c-4728-b774-080e11b9f874 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:06.855258 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-70de8d83-463c-4728-b774-080e11b9f874 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.311866 Jun 04 18:35:06.856091 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 304/586] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 4 18:35:06 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-interface => generated 285 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:07.288594 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-49c20ca9-d04d-4a0c-a20b-ea7670f1eaae tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:07.289208 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-49c20ca9-d04d-4a0c-a20b-ea7670f1eaae tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:07.296209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-49c20ca9-d04d-4a0c-a20b-ea7670f1eaae tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:07.296656 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-49c20ca9-d04d-4a0c-a20b-ea7670f1eaae tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:07.297418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-49c20ca9-d04d-4a0c-a20b-ea7670f1eaae tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:07.297861 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-49c20ca9-d04d-4a0c-a20b-ea7670f1eaae tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:07.434353 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-49c20ca9-d04d-4a0c-a20b-ea7670f1eaae tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:07.442120 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-49c20ca9-d04d-4a0c-a20b-ea7670f1eaae tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.157952 Jun 04 18:35:07.442797 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 283/587] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:07 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:07.961934 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-c397bbfd-a87a-428e-9370-2000125f2644 req-02359966-e2fd-4059-841c-2b230c0c1031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989409f2-e7e3-4010-b525-e7389d3eb160", "tag": "567a5b78-fc36-4e1e-ac0f-a5278d2fcb79"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:07.970049 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c397bbfd-a87a-428e-9370-2000125f2644 req-02359966-e2fd-4059-841c-2b230c0c1031 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:07.970486 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c397bbfd-a87a-428e-9370-2000125f2644 req-02359966-e2fd-4059-841c-2b230c0c1031 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:07.981751 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-c397bbfd-a87a-428e-9370-2000125f2644 req-02359966-e2fd-4059-841c-2b230c0c1031 service nova] Creating event network-changed:567a5b78-fc36-4e1e-ac0f-a5278d2fcb79 for instance 989409f2-e7e3-4010-b525-e7389d3eb160 on hv-cinder-79053 Jun 04 18:35:07.986870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-c397bbfd-a87a-428e-9370-2000125f2644 req-02359966-e2fd-4059-841c-2b230c0c1031 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091726 Jun 04 18:35:07.987461 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 305/588] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:08.459628 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-75014371-eca0-4d8f-9c07-a672ff56f174 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:08.460951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-75014371-eca0-4d8f-9c07-a672ff56f174 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:08.468706 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-75014371-eca0-4d8f-9c07-a672ff56f174 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:08.469557 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-75014371-eca0-4d8f-9c07-a672ff56f174 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:08.472418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-75014371-eca0-4d8f-9c07-a672ff56f174 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:08.473061 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-75014371-eca0-4d8f-9c07-a672ff56f174 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:08.611544 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-75014371-eca0-4d8f-9c07-a672ff56f174 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:08.619911 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-75014371-eca0-4d8f-9c07-a672ff56f174 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.164810 Jun 04 18:35:08.620526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 284/589] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:08 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:09.639532 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7e5272b2-a1d7-4a72-9954-cc44f233bb55 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:09.640359 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7e5272b2-a1d7-4a72-9954-cc44f233bb55 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:09.648116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e5272b2-a1d7-4a72-9954-cc44f233bb55 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:09.648566 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e5272b2-a1d7-4a72-9954-cc44f233bb55 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:09.649325 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e5272b2-a1d7-4a72-9954-cc44f233bb55 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:09.649800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e5272b2-a1d7-4a72-9954-cc44f233bb55 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:09.789112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7e5272b2-a1d7-4a72-9954-cc44f233bb55 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:09.796692 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7e5272b2-a1d7-4a72-9954-cc44f233bb55 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.163085 Jun 04 18:35:09.797260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 306/590] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:09 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:10.005668 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-486928ac-2ee7-4932-91d6-9e1b2221080d req-498cf8f4-6e9a-47c1-bcb4-30055f68d7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989409f2-e7e3-4010-b525-e7389d3eb160", "tag": "567a5b78-fc36-4e1e-ac0f-a5278d2fcb79"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:10.014952 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-486928ac-2ee7-4932-91d6-9e1b2221080d req-498cf8f4-6e9a-47c1-bcb4-30055f68d7c3 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:10.015396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-486928ac-2ee7-4932-91d6-9e1b2221080d req-498cf8f4-6e9a-47c1-bcb4-30055f68d7c3 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:10.026814 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-486928ac-2ee7-4932-91d6-9e1b2221080d req-498cf8f4-6e9a-47c1-bcb4-30055f68d7c3 service nova] Creating event network-changed:567a5b78-fc36-4e1e-ac0f-a5278d2fcb79 for instance 989409f2-e7e3-4010-b525-e7389d3eb160 on hv-cinder-79053 Jun 04 18:35:10.032414 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-486928ac-2ee7-4932-91d6-9e1b2221080d req-498cf8f4-6e9a-47c1-bcb4-30055f68d7c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032391 Jun 04 18:35:10.032891 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 285/591] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:10.820369 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5de55ea6-1ff8-498a-9cf9-b4daaea71482 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:10.820963 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5de55ea6-1ff8-498a-9cf9-b4daaea71482 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:10.828953 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5de55ea6-1ff8-498a-9cf9-b4daaea71482 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:10.829410 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5de55ea6-1ff8-498a-9cf9-b4daaea71482 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:10.830220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5de55ea6-1ff8-498a-9cf9-b4daaea71482 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:10.830658 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5de55ea6-1ff8-498a-9cf9-b4daaea71482 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:10.963562 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5de55ea6-1ff8-498a-9cf9-b4daaea71482 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:10.974732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5de55ea6-1ff8-498a-9cf9-b4daaea71482 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.161806 Jun 04 18:35:10.975292 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 307/592] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:10 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:11.993453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a8bc17c2-ccbe-4998-ba42-6ecea0c49b5f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:11.994150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a8bc17c2-ccbe-4998-ba42-6ecea0c49b5f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:12.000777 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a8bc17c2-ccbe-4998-ba42-6ecea0c49b5f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:12.001227 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a8bc17c2-ccbe-4998-ba42-6ecea0c49b5f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:12.001992 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a8bc17c2-ccbe-4998-ba42-6ecea0c49b5f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:12.002428 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a8bc17c2-ccbe-4998-ba42-6ecea0c49b5f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:12.140596 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a8bc17c2-ccbe-4998-ba42-6ecea0c49b5f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:12.152251 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a8bc17c2-ccbe-4998-ba42-6ecea0c49b5f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.164605 Jun 04 18:35:12.153027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 286/593] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:11 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:13.172338 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4a86cd9e-5365-410a-9fde-a63dd90eb175 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:13.172964 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4a86cd9e-5365-410a-9fde-a63dd90eb175 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:13.180048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a86cd9e-5365-410a-9fde-a63dd90eb175 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:13.180536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a86cd9e-5365-410a-9fde-a63dd90eb175 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:13.181306 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a86cd9e-5365-410a-9fde-a63dd90eb175 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:13.181754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a86cd9e-5365-410a-9fde-a63dd90eb175 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:13.321779 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4a86cd9e-5365-410a-9fde-a63dd90eb175 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:13.325469 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:13.330321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4a86cd9e-5365-410a-9fde-a63dd90eb175 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.161983 Jun 04 18:35:13.330894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 308/594] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:13 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:14.053012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-cf77fac3-9d2b-4e97-b152-bb0a13f5e1d8 req-6df4f472-e04e-4ef8-a687-46bd7eec677e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19a4a77-7305-41d2-913c-d40b18d5d926", "name": "network-vif-plugged", "status": "completed", "tag": "579c9e95-870c-43c9-9e8c-5736b6552a27"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:14.061362 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-cf77fac3-9d2b-4e97-b152-bb0a13f5e1d8 req-6df4f472-e04e-4ef8-a687-46bd7eec677e service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:14.061820 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-cf77fac3-9d2b-4e97-b152-bb0a13f5e1d8 req-6df4f472-e04e-4ef8-a687-46bd7eec677e service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:14.073027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-cf77fac3-9d2b-4e97-b152-bb0a13f5e1d8 req-6df4f472-e04e-4ef8-a687-46bd7eec677e service nova] Creating event network-vif-plugged:579c9e95-870c-43c9-9e8c-5736b6552a27 for instance e19a4a77-7305-41d2-913c-d40b18d5d926 on hv-cinder-79053 Jun 04 18:35:14.077856 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-cf77fac3-9d2b-4e97-b152-bb0a13f5e1d8 req-6df4f472-e04e-4ef8-a687-46bd7eec677e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086515 Jun 04 18:35:14.078434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 287/595] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:14.347398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a3fa0539-8fa5-468e-80d2-458c5d6c1760 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:14.348033 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a3fa0539-8fa5-468e-80d2-458c5d6c1760 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:14.355703 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a3fa0539-8fa5-468e-80d2-458c5d6c1760 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:14.356187 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a3fa0539-8fa5-468e-80d2-458c5d6c1760 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:14.356973 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a3fa0539-8fa5-468e-80d2-458c5d6c1760 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:14.357407 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a3fa0539-8fa5-468e-80d2-458c5d6c1760 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:14.493411 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a3fa0539-8fa5-468e-80d2-458c5d6c1760 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:14.501300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a3fa0539-8fa5-468e-80d2-458c5d6c1760 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.158223 Jun 04 18:35:14.501864 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 309/596] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:14 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:15.524616 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-516c44e2-3725-48de-8371-71ea65cdc304 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:15.525425 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-516c44e2-3725-48de-8371-71ea65cdc304 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:15.533260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-516c44e2-3725-48de-8371-71ea65cdc304 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:15.533780 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-516c44e2-3725-48de-8371-71ea65cdc304 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:15.534676 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-516c44e2-3725-48de-8371-71ea65cdc304 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:15.535531 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-516c44e2-3725-48de-8371-71ea65cdc304 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:15.689373 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-516c44e2-3725-48de-8371-71ea65cdc304 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:15.697572 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-516c44e2-3725-48de-8371-71ea65cdc304 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1265 microversion: 2.1 time: 0.180974 Jun 04 18:35:15.698124 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 288/597] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:15 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:16.718413 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ec25d180-4a5e-4f8e-a1fb-b8c5935a7453 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:16.719301 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ec25d180-4a5e-4f8e-a1fb-b8c5935a7453 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:16.729026 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ec25d180-4a5e-4f8e-a1fb-b8c5935a7453 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:16.729474 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ec25d180-4a5e-4f8e-a1fb-b8c5935a7453 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:16.730240 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ec25d180-4a5e-4f8e-a1fb-b8c5935a7453 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:16.730671 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ec25d180-4a5e-4f8e-a1fb-b8c5935a7453 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:16.866762 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ec25d180-4a5e-4f8e-a1fb-b8c5935a7453 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:16.874504 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ec25d180-4a5e-4f8e-a1fb-b8c5935a7453 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1453 microversion: 2.1 time: 0.162764 Jun 04 18:35:16.875040 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 310/598] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:16 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:16.890353 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b2930ed6-3530-4742-9f6a-9aaaee2b32a6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:16.890960 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b2930ed6-3530-4742-9f6a-9aaaee2b32a6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:16.897562 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2930ed6-3530-4742-9f6a-9aaaee2b32a6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:16.898071 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2930ed6-3530-4742-9f6a-9aaaee2b32a6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:16.898824 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2930ed6-3530-4742-9f6a-9aaaee2b32a6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:16.899253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2930ed6-3530-4742-9f6a-9aaaee2b32a6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:17.039126 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b2930ed6-3530-4742-9f6a-9aaaee2b32a6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:17.050781 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b2930ed6-3530-4742-9f6a-9aaaee2b32a6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1453 microversion: 2.1 time: 0.163915 Jun 04 18:35:17.051618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 289/599] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:16 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:19.080129 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-342a8a44-434c-432f-8b04-6bf65e58fa4e req-a4bc6d83-835b-4ae1-af39-36266101c042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19a4a77-7305-41d2-913c-d40b18d5d926", "tag": "579c9e95-870c-43c9-9e8c-5736b6552a27"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:19.089936 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-342a8a44-434c-432f-8b04-6bf65e58fa4e req-a4bc6d83-835b-4ae1-af39-36266101c042 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:19.090384 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-342a8a44-434c-432f-8b04-6bf65e58fa4e req-a4bc6d83-835b-4ae1-af39-36266101c042 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:19.109230 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-342a8a44-434c-432f-8b04-6bf65e58fa4e req-a4bc6d83-835b-4ae1-af39-36266101c042 service nova] Creating event network-changed:579c9e95-870c-43c9-9e8c-5736b6552a27 for instance e19a4a77-7305-41d2-913c-d40b18d5d926 on hv-cinder-79053 Jun 04 18:35:19.114812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-342a8a44-434c-432f-8b04-6bf65e58fa4e req-a4bc6d83-835b-4ae1-af39-36266101c042 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038372 Jun 04 18:35:19.115455 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 311/600] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:43.503504 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=31 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:43.505485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:43.610619 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9d0ff839-cc7d-4114-b63d-ea11c97ef8dd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:43.611116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9d0ff839-cc7d-4114-b63d-ea11c97ef8dd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:43.617351 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9d0ff839-cc7d-4114-b63d-ea11c97ef8dd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:43.617803 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9d0ff839-cc7d-4114-b63d-ea11c97ef8dd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:43.618563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9d0ff839-cc7d-4114-b63d-ea11c97ef8dd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:43.618994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9d0ff839-cc7d-4114-b63d-ea11c97ef8dd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:43.643210 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9d0ff839-cc7d-4114-b63d-ea11c97ef8dd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54/ips" status: 200 len: 151 microversion: 2.1 time: 0.149203 Jun 04 18:35:43.643732 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 290/601] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:35:43 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54/ips => generated 151 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:43.652437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=41 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:43.653247 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=14 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:43.658056 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a39998-6ea5-4052-95e1-eb0d97642622"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:43.659231 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:43.666604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:43.667058 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:43.667819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:43.668300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:43.750792 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Invalid volume: volume 18a39998-6ea5-4052-95e1-eb0d97642622 is already attached to instances: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: POST /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54/os-volume_attachments HTTP/1.1 Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 74 Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:35:43.752552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {"volumeAttachment": {"volumeId": "18a39998-6ea5-4052-95e1-eb0d97642622"}} Jun 04 18:35:43.754022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Invalid volume: volume 18a39998-6ea5-4052-95e1-eb0d97642622 is already attached to instances: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'server_id': '1205f37f-ca68-4d25-83e9-ad88c6f52c54', 'body': {'volumeAttachment': {'volumeId': '18a39998-6ea5-4052-95e1-eb0d97642622'}}} Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 18a39998-6ea5-4052-95e1-eb0d97642622 is already attached to instances: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:43.754868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 18a39998-6ea5-4052-95e1-eb0d97642622 is already attached to instances: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:43.756094 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:35:43.757478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:35:43.757478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:35:43.757478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:35:43.757478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 18a39998-6ea5-4052-95e1-eb0d97642622 is already attached to instances: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 Jun 04 18:35:43.757478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:43.757478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 400 to user: Invalid volume: volume 18a39998-6ea5-4052-95e1-eb0d97642622 is already attached to instances: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:35:43.757478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8eb5fd09-a689-49a5-a89a-967649e69b5d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103307 Jun 04 18:35:43.757478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 312/602] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:35:43 2022] POST /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:35:43.763563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f82b270e-997a-420f-aaa6-fc92886cd3ff tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:43.764111 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f82b270e-997a-420f-aaa6-fc92886cd3ff tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:43.770556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f82b270e-997a-420f-aaa6-fc92886cd3ff tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:43.771008 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f82b270e-997a-420f-aaa6-fc92886cd3ff tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:43.771767 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f82b270e-997a-420f-aaa6-fc92886cd3ff tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:43.772268 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f82b270e-997a-420f-aaa6-fc92886cd3ff tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:43.797653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f82b270e-997a-420f-aaa6-fc92886cd3ff tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:35:43.888071 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f82b270e-997a-420f-aaa6-fc92886cd3ff tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 204 len: 0 microversion: 2.1 time: 0.128368 Jun 04 18:35:43.888720 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 291/603] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:35:43 2022] DELETE /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:35:43.899157 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6532e52b-c40e-4a4e-bbfb-df5ae1078b0f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:43.899986 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6532e52b-c40e-4a4e-bbfb-df5ae1078b0f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:43.908304 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6532e52b-c40e-4a4e-bbfb-df5ae1078b0f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:43.908750 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6532e52b-c40e-4a4e-bbfb-df5ae1078b0f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:43.909843 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6532e52b-c40e-4a4e-bbfb-df5ae1078b0f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:43.910277 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6532e52b-c40e-4a4e-bbfb-df5ae1078b0f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:44.050018 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6532e52b-c40e-4a4e-bbfb-df5ae1078b0f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:44.058117 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6532e52b-c40e-4a4e-bbfb-df5ae1078b0f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1684 microversion: 2.1 time: 0.164876 Jun 04 18:35:44.058643 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 313/604] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:43 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:35:45.082296 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a61a005f-6fab-40ff-936d-73b798c474d1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:45.083442 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a61a005f-6fab-40ff-936d-73b798c474d1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:45.094884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a61a005f-6fab-40ff-936d-73b798c474d1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:45.095634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a61a005f-6fab-40ff-936d-73b798c474d1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:45.097013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a61a005f-6fab-40ff-936d-73b798c474d1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:45.097729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a61a005f-6fab-40ff-936d-73b798c474d1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:45.244872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a61a005f-6fab-40ff-936d-73b798c474d1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:45.253440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a61a005f-6fab-40ff-936d-73b798c474d1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1684 microversion: 2.1 time: 0.178575 Jun 04 18:35:45.254006 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 292/605] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:45 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:46.271292 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5a38840e-a703-496b-a084-7c42cb382d44 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:46.271894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5a38840e-a703-496b-a084-7c42cb382d44 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:46.278676 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5a38840e-a703-496b-a084-7c42cb382d44 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:46.279113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5a38840e-a703-496b-a084-7c42cb382d44 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:46.279878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5a38840e-a703-496b-a084-7c42cb382d44 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:46.280331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5a38840e-a703-496b-a084-7c42cb382d44 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:46.348068 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5a38840e-a703-496b-a084-7c42cb382d44 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:46.355856 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5a38840e-a703-496b-a084-7c42cb382d44 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 200 len: 1616 microversion: 2.1 time: 0.088496 Jun 04 18:35:46.357430 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 314/606] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:46 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 1616 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:46.587142 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-a536151b-1aee-43fb-b184-4ceb97796ae9 req-3f743019-ad92-47c2-a1a0-eebac98c3a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1205f37f-ca68-4d25-83e9-ad88c6f52c54", "name": "network-vif-deleted", "tag": "99370f44-721a-4281-9290-53ddfa929801"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:46.602634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a536151b-1aee-43fb-b184-4ceb97796ae9 req-3f743019-ad92-47c2-a1a0-eebac98c3a4b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:46.603574 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a536151b-1aee-43fb-b184-4ceb97796ae9 req-3f743019-ad92-47c2-a1a0-eebac98c3a4b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:46.616728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-a536151b-1aee-43fb-b184-4ceb97796ae9 req-3f743019-ad92-47c2-a1a0-eebac98c3a4b service nova] Creating event network-vif-deleted:99370f44-721a-4281-9290-53ddfa929801 for instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 on hv-cinder-79053 Jun 04 18:35:46.622126 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-a536151b-1aee-43fb-b184-4ceb97796ae9 req-3f743019-ad92-47c2-a1a0-eebac98c3a4b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038938 Jun 04 18:35:46.623570 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 293/607] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:47.373601 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:47.374203 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:47.381175 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:47.381651 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:47.382418 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:47.382847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:47.397965 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 HTTP/1.1 Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:35:47.399485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:35:47.401096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '1205f37f-ca68-4d25-83e9-ad88c6f52c54'} Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:35:47.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:35:47.403048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:47.404368 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:35:47.404368 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-45bb6833-436c-4c74-ac49-af32913ce530 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 404 len: 111 microversion: 2.1 time: 0.031364 Jun 04 18:35:47.404368 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 315/608] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:47 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:35:47.410901 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e020bab6-f443-424b-9a82-380cc94e720b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '.version_select at 0x7f467df799d0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:47.435714 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e020bab6-f443-424b-9a82-380cc94e720b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421671281" status: 202 len: 0 microversion: 2.1 time: 0.029345 Jun 04 18:35:47.436769 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 294/609] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 4 18:35:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421671281 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:35:48.360974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cdc9284b-ee6d-476d-a9a2-eb1271378ba2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:48.361483 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cdc9284b-ee6d-476d-a9a2-eb1271378ba2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:48.367593 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cdc9284b-ee6d-476d-a9a2-eb1271378ba2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:48.368111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cdc9284b-ee6d-476d-a9a2-eb1271378ba2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:48.368910 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cdc9284b-ee6d-476d-a9a2-eb1271378ba2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:48.369351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cdc9284b-ee6d-476d-a9a2-eb1271378ba2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:48.452456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-cdc9284b-ee6d-476d-a9a2-eb1271378ba2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lazy-loading 'services' on Instance uuid a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:35:48.537419 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cdc9284b-ee6d-476d-a9a2-eb1271378ba2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-volume_attachments/18a39998-6ea5-4052-95e1-eb0d97642622" status: 202 len: 0 microversion: 2.1 time: 0.180269 Jun 04 18:35:48.538166 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 316/610] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:35:48 2022] DELETE /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-volume_attachments/18a39998-6ea5-4052-95e1-eb0d97642622 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:35:48.548255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-465823df-9115-4fcd-9e50-8b6974738c3a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:48.550636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-465823df-9115-4fcd-9e50-8b6974738c3a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:48.560077 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-465823df-9115-4fcd-9e50-8b6974738c3a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:48.560756 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-465823df-9115-4fcd-9e50-8b6974738c3a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:48.561486 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-465823df-9115-4fcd-9e50-8b6974738c3a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:48.561946 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-465823df-9115-4fcd-9e50-8b6974738c3a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:48.594150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-465823df-9115-4fcd-9e50-8b6974738c3a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051483 Jun 04 18:35:48.594817 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 295/611] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:35:48 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:49.606601 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a9253e5e-ef37-4d02-bc55-bc7abadcfc12 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:49.607687 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a9253e5e-ef37-4d02-bc55-bc7abadcfc12 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:49.615283 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9253e5e-ef37-4d02-bc55-bc7abadcfc12 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:49.615728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9253e5e-ef37-4d02-bc55-bc7abadcfc12 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:49.616530 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9253e5e-ef37-4d02-bc55-bc7abadcfc12 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:49.616962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9253e5e-ef37-4d02-bc55-bc7abadcfc12 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:49.648049 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a9253e5e-ef37-4d02-bc55-bc7abadcfc12 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045671 Jun 04 18:35:49.648688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 317/612] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:35:49 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:35:49.710729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5ebe8640-3a43-4402-94ba-3de472b3459f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:49.711289 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5ebe8640-3a43-4402-94ba-3de472b3459f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:49.718361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ebe8640-3a43-4402-94ba-3de472b3459f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:49.718784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ebe8640-3a43-4402-94ba-3de472b3459f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:49.719561 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ebe8640-3a43-4402-94ba-3de472b3459f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:49.720003 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ebe8640-3a43-4402-94ba-3de472b3459f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:49.746044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5ebe8640-3a43-4402-94ba-3de472b3459f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:35:49.840474 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5ebe8640-3a43-4402-94ba-3de472b3459f tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 204 len: 0 microversion: 2.1 time: 0.133123 Jun 04 18:35:49.841092 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 296/613] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:35:49 2022] DELETE /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:35:49.849995 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3f2fecd0-bd33-4dfd-915d-23fbf61a4977 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:49.850606 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3f2fecd0-bd33-4dfd-915d-23fbf61a4977 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:49.857332 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3f2fecd0-bd33-4dfd-915d-23fbf61a4977 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:49.857783 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3f2fecd0-bd33-4dfd-915d-23fbf61a4977 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:49.858987 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3f2fecd0-bd33-4dfd-915d-23fbf61a4977 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:49.859370 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3f2fecd0-bd33-4dfd-915d-23fbf61a4977 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:49.992844 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3f2fecd0-bd33-4dfd-915d-23fbf61a4977 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:50.001172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3f2fecd0-bd33-4dfd-915d-23fbf61a4977 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1683 microversion: 2.1 time: 0.155043 Jun 04 18:35:50.001667 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 318/614] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:49 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:51.020200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b02bd4e1-16a8-4366-a5be-3356e7bcfe84 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:51.020935 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b02bd4e1-16a8-4366-a5be-3356e7bcfe84 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:51.029795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b02bd4e1-16a8-4366-a5be-3356e7bcfe84 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:51.030248 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b02bd4e1-16a8-4366-a5be-3356e7bcfe84 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:51.031040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b02bd4e1-16a8-4366-a5be-3356e7bcfe84 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:51.031480 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b02bd4e1-16a8-4366-a5be-3356e7bcfe84 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:51.167172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b02bd4e1-16a8-4366-a5be-3356e7bcfe84 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:51.176328 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b02bd4e1-16a8-4366-a5be-3356e7bcfe84 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1683 microversion: 2.1 time: 0.160455 Jun 04 18:35:51.176902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 297/615] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:51 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:52.194192 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ba82e6cf-6b0b-4d77-8686-0b4c2fa4131c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:52.194804 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ba82e6cf-6b0b-4d77-8686-0b4c2fa4131c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:52.203014 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba82e6cf-6b0b-4d77-8686-0b4c2fa4131c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:52.204159 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba82e6cf-6b0b-4d77-8686-0b4c2fa4131c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:52.204947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba82e6cf-6b0b-4d77-8686-0b4c2fa4131c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:52.205385 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba82e6cf-6b0b-4d77-8686-0b4c2fa4131c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:52.341514 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ba82e6cf-6b0b-4d77-8686-0b4c2fa4131c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:52.349529 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ba82e6cf-6b0b-4d77-8686-0b4c2fa4131c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 200 len: 1683 microversion: 2.1 time: 0.159222 Jun 04 18:35:52.350072 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 319/616] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:52 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:52.724519 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-e4b2893a-d236-4307-b055-2f46e87cb915 req-c95dbdf5-aac1-4c70-866a-c0c66dc79371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31", "name": "network-vif-deleted", "tag": "2b7956c3-20c4-469e-ae08-40dda4b0084a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:52.733752 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e4b2893a-d236-4307-b055-2f46e87cb915 req-c95dbdf5-aac1-4c70-866a-c0c66dc79371 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:52.734470 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e4b2893a-d236-4307-b055-2f46e87cb915 req-c95dbdf5-aac1-4c70-866a-c0c66dc79371 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:52.746107 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-e4b2893a-d236-4307-b055-2f46e87cb915 req-c95dbdf5-aac1-4c70-866a-c0c66dc79371 service nova] Creating event network-vif-deleted:2b7956c3-20c4-469e-ae08-40dda4b0084a for instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 on hv-cinder-79053 Jun 04 18:35:52.751589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-e4b2893a-d236-4307-b055-2f46e87cb915 req-c95dbdf5-aac1-4c70-866a-c0c66dc79371 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030554 Jun 04 18:35:52.752606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 298/617] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:53.369165 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:53.369781 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:53.378072 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:53.378652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:53.379691 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:53.380387 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:53.396866 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 HTTP/1.1 Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:35:53.398554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:35:53.399914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31'} Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:35:53.400715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:35:53.401969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:35:53.403103 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:35:53.403103 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d3c0944f-00d7-4f9f-a8de-ec4c74f5b685 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 404 len: 111 microversion: 2.1 time: 0.035662 Jun 04 18:35:53.403103 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 320/618] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:53 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:35:53.410502 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-420ceddb-3d9b-4ef0-a8f9-46d11ab1c2d4 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '.version_select at 0x7f467df0e160>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:53.430312 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-420ceddb-3d9b-4ef0-a8f9-46d11ab1c2d4 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762085348" status: 202 len: 0 microversion: 2.1 time: 0.024453 Jun 04 18:35:53.430925 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 299/619] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 4 18:35:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762085348 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:35:54.071071 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-03dc523f-6c66-4973-afb6-ff92278118d7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: .version_select at 0x7f467e6484c0>, body: {"keypair": {"name": "tempest-keypair-808501479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcP1Q4oqZMJyl1uuwb27I/UoQlqtNq84y/hmFUd3/4XsZnT/V+l8EvEuoSVfw/r25pN7Qq4U0YNRKH/BzF/VBoDLZPsU/20bEO1CCMJv82MYf/9yw18p8GZtHlyULdG/A=="}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:54.090891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-03dc523f-6c66-4973-afb6-ff92278118d7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:35:54.095156 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-03dc523f-6c66-4973-afb6-ff92278118d7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for user 5b5a9f5cdfa6494d97617d68880d5552 and project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:35:54.141286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-03dc523f-6c66-4973-afb6-ff92278118d7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073933 Jun 04 18:35:54.141800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 321/620] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:35:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:55.455929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-25049070", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2590cab-faa4-4157-aaba-3c7a446c9e61"}], "security_groups": [{"name": "tempest-securitygroup--621072194"}], "key_name": "tempest-keypair-808501479", "user_data": "}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:55.565747 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] validate_networks() for [('e2590cab-faa4-4157-aaba-3c7a446c9e61', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:35:55.940563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:35:55.941065 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:35:55.941682 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:35:55.942099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:35:55.942584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:35:55.952667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:55.953115 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:55.953918 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:55.954356 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:55.971874 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:35:55.976318 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for user 5b5a9f5cdfa6494d97617d68880d5552 and project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:35:55.988647 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:35:55.991048 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:35:56.046252 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2974196c-742f-45ab-8871-d284da81a6c0 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594524 Jun 04 18:35:56.047174 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 300/621] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:35:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:35:56.058116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-85d43efa-de91-404f-9a06-1f10e755ead2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:56.058715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-85d43efa-de91-404f-9a06-1f10e755ead2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:56.126260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-85d43efa-de91-404f-9a06-1f10e755ead2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:56.133881 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-85d43efa-de91-404f-9a06-1f10e755ead2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1239 microversion: 2.1 time: 0.080386 Jun 04 18:35:56.136369 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 322/622] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:56 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:57.151611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7be11e65-b50b-43e7-82af-9c8a5033e1e7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:57.152361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7be11e65-b50b-43e7-82af-9c8a5033e1e7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:57.161723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7be11e65-b50b-43e7-82af-9c8a5033e1e7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:57.162784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7be11e65-b50b-43e7-82af-9c8a5033e1e7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:57.163870 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7be11e65-b50b-43e7-82af-9c8a5033e1e7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:57.164785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7be11e65-b50b-43e7-82af-9c8a5033e1e7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:57.257080 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7be11e65-b50b-43e7-82af-9c8a5033e1e7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:57.268516 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7be11e65-b50b-43e7-82af-9c8a5033e1e7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1309 microversion: 2.1 time: 0.121211 Jun 04 18:35:57.269381 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 301/623] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:57 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:58.290572 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-003edaca-d583-43d7-96f7-d70ebc658af7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:58.291231 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-003edaca-d583-43d7-96f7-d70ebc658af7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:58.298480 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-003edaca-d583-43d7-96f7-d70ebc658af7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:58.298937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-003edaca-d583-43d7-96f7-d70ebc658af7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:58.299729 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-003edaca-d583-43d7-96f7-d70ebc658af7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:58.300209 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-003edaca-d583-43d7-96f7-d70ebc658af7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:58.438713 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-003edaca-d583-43d7-96f7-d70ebc658af7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:58.446867 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-003edaca-d583-43d7-96f7-d70ebc658af7 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1364 microversion: 2.1 time: 0.160172 Jun 04 18:35:58.447435 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 323/624] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:58 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:35:58.822022 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-06935428-c3f4-433d-9279-58888273f34b req-3d0beb42-5d56-4c5c-9fea-4652180af5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b570f772-6dc1-446e-9bdb-4368b8e409b4", "tag": "6bfff902-7d99-4486-bc8e-075cd1d5cd14"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:35:58.833339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-06935428-c3f4-433d-9279-58888273f34b req-3d0beb42-5d56-4c5c-9fea-4652180af5f6 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:58.834088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-06935428-c3f4-433d-9279-58888273f34b req-3d0beb42-5d56-4c5c-9fea-4652180af5f6 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:58.847404 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-06935428-c3f4-433d-9279-58888273f34b req-3d0beb42-5d56-4c5c-9fea-4652180af5f6 service nova] Creating event network-changed:6bfff902-7d99-4486-bc8e-075cd1d5cd14 for instance b570f772-6dc1-446e-9bdb-4368b8e409b4 on hv-cinder-79053 Jun 04 18:35:58.852909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-06935428-c3f4-433d-9279-58888273f34b req-3d0beb42-5d56-4c5c-9fea-4652180af5f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035393 Jun 04 18:35:58.853616 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 302/625] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:35:59.467897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b55aba35-feb3-4575-bd98-bd26a9abab11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:35:59.469440 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b55aba35-feb3-4575-bd98-bd26a9abab11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:35:59.475778 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b55aba35-feb3-4575-bd98-bd26a9abab11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:59.476293 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b55aba35-feb3-4575-bd98-bd26a9abab11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:59.477062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b55aba35-feb3-4575-bd98-bd26a9abab11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:35:59.477484 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b55aba35-feb3-4575-bd98-bd26a9abab11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:35:59.617671 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b55aba35-feb3-4575-bd98-bd26a9abab11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:35:59.625254 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b55aba35-feb3-4575-bd98-bd26a9abab11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1364 microversion: 2.1 time: 0.163971 Jun 04 18:35:59.625784 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 324/626] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:35:59 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:00.644368 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e3e813d5-21fb-4d70-aac5-0cb51fe25c81 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:00.644977 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e3e813d5-21fb-4d70-aac5-0cb51fe25c81 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:00.651595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e3e813d5-21fb-4d70-aac5-0cb51fe25c81 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:00.652042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e3e813d5-21fb-4d70-aac5-0cb51fe25c81 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:00.652877 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e3e813d5-21fb-4d70-aac5-0cb51fe25c81 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:00.653311 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e3e813d5-21fb-4d70-aac5-0cb51fe25c81 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:00.788267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e3e813d5-21fb-4d70-aac5-0cb51fe25c81 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:00.796090 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e3e813d5-21fb-4d70-aac5-0cb51fe25c81 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1364 microversion: 2.1 time: 0.157139 Jun 04 18:36:00.796665 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 303/627] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:00 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:01.815206 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9a7e3976-377a-4e58-a8aa-d8eb34833d65 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:01.815830 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9a7e3976-377a-4e58-a8aa-d8eb34833d65 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:01.822946 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a7e3976-377a-4e58-a8aa-d8eb34833d65 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:01.823393 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a7e3976-377a-4e58-a8aa-d8eb34833d65 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:01.824200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a7e3976-377a-4e58-a8aa-d8eb34833d65 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:01.824635 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a7e3976-377a-4e58-a8aa-d8eb34833d65 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:01.965480 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9a7e3976-377a-4e58-a8aa-d8eb34833d65 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:01.973484 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9a7e3976-377a-4e58-a8aa-d8eb34833d65 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1364 microversion: 2.1 time: 0.163262 Jun 04 18:36:01.974021 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 325/628] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:01 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:02.992139 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-579276e0-fe29-459f-88e5-50f6bb7b068d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:02.992785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-579276e0-fe29-459f-88e5-50f6bb7b068d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:03.000585 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-579276e0-fe29-459f-88e5-50f6bb7b068d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:03.001077 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-579276e0-fe29-459f-88e5-50f6bb7b068d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:03.001886 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-579276e0-fe29-459f-88e5-50f6bb7b068d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:03.002383 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-579276e0-fe29-459f-88e5-50f6bb7b068d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:03.152509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-579276e0-fe29-459f-88e5-50f6bb7b068d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:03.161729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-579276e0-fe29-459f-88e5-50f6bb7b068d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1364 microversion: 2.1 time: 0.174025 Jun 04 18:36:03.162699 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 304/629] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:02 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:03.865389 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6bfe2bed-3301-4eab-8ddf-0f86d31541e4 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1289180485"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:03.865896 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6bfe2bed-3301-4eab-8ddf-0f86d31541e4 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:03.873177 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bed-3301-4eab-8ddf-0f86d31541e4 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:03.873628 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bed-3301-4eab-8ddf-0f86d31541e4 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:03.874387 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bed-3301-4eab-8ddf-0f86d31541e4 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:03.874878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6bfe2bed-3301-4eab-8ddf-0f86d31541e4 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:04.006498 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.network.security_group_api [None req-6bfe2bed-3301-4eab-8ddf-0f86d31541e4 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Removing security group 37e62876-6b69-4ac5-ad15-7717b62d5194 from port 6dd02dd3-7f7a-45a5-b6b6-da67814319b2 Jun 04 18:36:04.179051 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bc357490-5b30-495f-99d5-9059a9187c70 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:04.180797 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bc357490-5b30-495f-99d5-9059a9187c70 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:04.188313 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc357490-5b30-495f-99d5-9059a9187c70 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:04.188945 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc357490-5b30-495f-99d5-9059a9187c70 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:04.189825 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc357490-5b30-495f-99d5-9059a9187c70 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:04.190461 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc357490-5b30-495f-99d5-9059a9187c70 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:04.327137 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bc357490-5b30-495f-99d5-9059a9187c70 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:04.334720 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bc357490-5b30-495f-99d5-9059a9187c70 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1364 microversion: 2.1 time: 0.159797 Jun 04 18:36:04.335288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 305/630] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:04 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:36:04.405655 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6bfe2bed-3301-4eab-8ddf-0f86d31541e4 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "POST /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/action" status: 202 len: 0 microversion: 2.1 time: 0.544330 Jun 04 18:36:04.410733 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 326/631] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:36:03 2022] POST /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:36:04.421846 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-a56904ee-75b0-474e-9668-c19166827a1e req-f3e216fa-8595-4f62-90f2-5cd99b85b9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e974c3d-7f67-46b4-91cf-27b8c2db1b13", "tag": "6dd02dd3-7f7a-45a5-b6b6-da67814319b2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:04.435872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a56904ee-75b0-474e-9668-c19166827a1e req-f3e216fa-8595-4f62-90f2-5cd99b85b9dd service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:04.437599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a56904ee-75b0-474e-9668-c19166827a1e req-f3e216fa-8595-4f62-90f2-5cd99b85b9dd service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:04.453772 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-a56904ee-75b0-474e-9668-c19166827a1e req-f3e216fa-8595-4f62-90f2-5cd99b85b9dd service nova] Creating event network-changed:6dd02dd3-7f7a-45a5-b6b6-da67814319b2 for instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 on hv-cinder-79053 Jun 04 18:36:04.460116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-a56904ee-75b0-474e-9668-c19166827a1e req-f3e216fa-8595-4f62-90f2-5cd99b85b9dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046386 Jun 04 18:36:04.461128 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 306/632] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:05.351198 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-72465d21-c121-47f5-a4f4-a9050d2579d8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:05.351794 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-72465d21-c121-47f5-a4f4-a9050d2579d8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:05.358737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72465d21-c121-47f5-a4f4-a9050d2579d8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:05.359306 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72465d21-c121-47f5-a4f4-a9050d2579d8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:05.360852 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72465d21-c121-47f5-a4f4-a9050d2579d8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:05.361544 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72465d21-c121-47f5-a4f4-a9050d2579d8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:05.499088 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-72465d21-c121-47f5-a4f4-a9050d2579d8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:05.506851 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-72465d21-c121-47f5-a4f4-a9050d2579d8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1364 microversion: 2.1 time: 0.159944 Jun 04 18:36:05.507397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 327/633] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:05 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:05.808271 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-d1eeeb41-a3ec-4931-9d7d-fe016aa79a52 req-d8f6aa37-134e-49ff-a33c-926d13743843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e974c3d-7f67-46b4-91cf-27b8c2db1b13", "tag": "6dd02dd3-7f7a-45a5-b6b6-da67814319b2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:05.808619 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8edc40cf-b867-451c-997e-38707a3a6869 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:05.809435 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8edc40cf-b867-451c-997e-38707a3a6869 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:05.816433 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8edc40cf-b867-451c-997e-38707a3a6869 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:05.816637 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d1eeeb41-a3ec-4931-9d7d-fe016aa79a52 req-d8f6aa37-134e-49ff-a33c-926d13743843 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:05.816986 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d1eeeb41-a3ec-4931-9d7d-fe016aa79a52 req-d8f6aa37-134e-49ff-a33c-926d13743843 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:05.817218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8edc40cf-b867-451c-997e-38707a3a6869 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:05.818227 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8edc40cf-b867-451c-997e-38707a3a6869 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:05.818763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8edc40cf-b867-451c-997e-38707a3a6869 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:05.828043 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-d1eeeb41-a3ec-4931-9d7d-fe016aa79a52 req-d8f6aa37-134e-49ff-a33c-926d13743843 service nova] Creating event network-changed:6dd02dd3-7f7a-45a5-b6b6-da67814319b2 for instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 on hv-cinder-79053 Jun 04 18:36:05.834089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-d1eeeb41-a3ec-4931-9d7d-fe016aa79a52 req-d8f6aa37-134e-49ff-a33c-926d13743843 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029064 Jun 04 18:36:05.835464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 328/634] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:36:05.910673 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-8edc40cf-b867-451c-997e-38707a3a6869 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lazy-loading 'services' on Instance uuid 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:36:05.961151 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:05.987454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:05.989732 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8edc40cf-b867-451c-997e-38707a3a6869 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments/295f027e-4cb6-4aff-81a8-97ef70afd102" status: 202 len: 0 microversion: 2.1 time: 0.186250 Jun 04 18:36:05.990796 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 307/635] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:36:05 2022] DELETE /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments/295f027e-4cb6-4aff-81a8-97ef70afd102 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:36:05.999562 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b564d560-42f0-4312-9d99-5b1304f602b3 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:06.000491 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b564d560-42f0-4312-9d99-5b1304f602b3 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:06.007793 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b564d560-42f0-4312-9d99-5b1304f602b3 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:06.008286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b564d560-42f0-4312-9d99-5b1304f602b3 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:06.009396 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b564d560-42f0-4312-9d99-5b1304f602b3 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:06.010160 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b564d560-42f0-4312-9d99-5b1304f602b3 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:06.042360 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b564d560-42f0-4312-9d99-5b1304f602b3 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047246 Jun 04 18:36:06.042927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 329/636] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:36:05 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:06.383961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-79dda182-181d-4d1e-8729-523fe0774780 req-8b169fa9-0d98-4d2e-8a3c-918154cc38b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b570f772-6dc1-446e-9bdb-4368b8e409b4", "name": "network-vif-plugged", "status": "completed", "tag": "6bfff902-7d99-4486-bc8e-075cd1d5cd14"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:06.393810 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-79dda182-181d-4d1e-8729-523fe0774780 req-8b169fa9-0d98-4d2e-8a3c-918154cc38b8 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:06.394267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-79dda182-181d-4d1e-8729-523fe0774780 req-8b169fa9-0d98-4d2e-8a3c-918154cc38b8 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:06.398502 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:06.407067 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-79dda182-181d-4d1e-8729-523fe0774780 req-8b169fa9-0d98-4d2e-8a3c-918154cc38b8 service nova] Creating event network-vif-plugged:6bfff902-7d99-4486-bc8e-075cd1d5cd14 for instance b570f772-6dc1-446e-9bdb-4368b8e409b4 on hv-cinder-79053 Jun 04 18:36:06.412526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-79dda182-181d-4d1e-8729-523fe0774780 req-8b169fa9-0d98-4d2e-8a3c-918154cc38b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032845 Jun 04 18:36:06.413169 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 308/637] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:06.525628 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-415784c5-a1d7-454d-bc61-c5a11b35367b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:06.527124 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-415784c5-a1d7-454d-bc61-c5a11b35367b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:06.530081 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:06.543422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-415784c5-a1d7-454d-bc61-c5a11b35367b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:06.544200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-415784c5-a1d7-454d-bc61-c5a11b35367b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:06.545689 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-415784c5-a1d7-454d-bc61-c5a11b35367b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:06.546280 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-415784c5-a1d7-454d-bc61-c5a11b35367b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:06.709322 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-415784c5-a1d7-454d-bc61-c5a11b35367b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:06.717617 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-415784c5-a1d7-454d-bc61-c5a11b35367b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1364 microversion: 2.1 time: 0.197142 Jun 04 18:36:06.728179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 330/638] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:06 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:07.055507 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-28dd6df2-ec3c-43bd-8b48-55188bf4dc54 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:07.057183 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-28dd6df2-ec3c-43bd-8b48-55188bf4dc54 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:07.064577 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28dd6df2-ec3c-43bd-8b48-55188bf4dc54 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:07.065033 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28dd6df2-ec3c-43bd-8b48-55188bf4dc54 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:07.065812 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28dd6df2-ec3c-43bd-8b48-55188bf4dc54 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:07.066251 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28dd6df2-ec3c-43bd-8b48-55188bf4dc54 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:07.097726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-28dd6df2-ec3c-43bd-8b48-55188bf4dc54 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Jun 04 18:36:07.098537 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 309/639] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:36:07 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:07.738326 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-99559391-038d-4035-889b-b2edd719037a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:07.739132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-99559391-038d-4035-889b-b2edd719037a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:07.746864 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99559391-038d-4035-889b-b2edd719037a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:07.747315 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99559391-038d-4035-889b-b2edd719037a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:07.748102 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99559391-038d-4035-889b-b2edd719037a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:07.748538 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99559391-038d-4035-889b-b2edd719037a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:07.885380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-99559391-038d-4035-889b-b2edd719037a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:07.893050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-99559391-038d-4035-889b-b2edd719037a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1364 microversion: 2.1 time: 0.160410 Jun 04 18:36:07.893605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 331/640] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:07 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:08.111772 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f5795a65-ae4d-4678-bba1-3f6c3f37520e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:08.112634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f5795a65-ae4d-4678-bba1-3f6c3f37520e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:08.121348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f5795a65-ae4d-4678-bba1-3f6c3f37520e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:08.121911 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f5795a65-ae4d-4678-bba1-3f6c3f37520e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:08.123092 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f5795a65-ae4d-4678-bba1-3f6c3f37520e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:08.123675 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f5795a65-ae4d-4678-bba1-3f6c3f37520e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:08.154277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f5795a65-ae4d-4678-bba1-3f6c3f37520e tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046791 Jun 04 18:36:08.154829 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 310/641] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:36:08 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:36:08.168439 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:08.169136 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:08.179277 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:08.179925 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:08.181173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:08.181819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:08.187638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:08.262060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] HTTP exception thrown: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 is not attached to volume 295f027e-4cb6-4aff-81a8-97ef70afd102 Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Request method failure captured: Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments/295f027e-4cb6-4aff-81a8-97ef70afd102 HTTP/1.1 Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6ULATe9giPkXVwWCkpyGxVv8q8doxW-Qi37K8Ht-2VH54U05kaApHuEVxcCTxt8CbjIVXjEoX7e7dHjKxgE1kWZrDCqMe7l_2OgWASKQJskn6jGNIHm_6Qj022CtXblMGRlsoB2RvO05s6TsEdfKqNRGOKWXc-itQFKIZca-PInLNs Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 5cfb3750227e4037b6e92552361366f4 Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-TestMinimumBasicScenario-1724516499 Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:36:08.264533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cfb3750227e4037b6e92552361366f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5cfb3750227e4037b6e92552361366f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5cfb3750227e4037b6e92552361366f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cfb3750227e4037b6e92552361366f4"}]}] Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-TestMinimumBasicScenario-1724516499 Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 5cfb3750227e4037b6e92552361366f4 Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1724516499 Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-TestMinimumBasicScenario-1724516499-project Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 2e0bd04828eb48bdbfe09fd01130ac73 Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-TestMinimumBasicScenario-1724516499-project Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:36:08.266050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 is not attached to volume 295f027e-4cb6-4aff-81a8-97ef70afd102 Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'server_id': '4e974c3d-7f67-46b4-91cf-27b8c2db1b13', 'id': '295f027e-4cb6-4aff-81a8-97ef70afd102'} Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 295f027e-4cb6-4aff-81a8-97ef70afd102. Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:36:08.266908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 is not attached to volume 295f027e-4cb6-4aff-81a8-97ef70afd102 Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 is not attached to volume 295f027e-4cb6-4aff-81a8-97ef70afd102 Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:08.268429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Returning 404 to user: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 is not attached to volume 295f027e-4cb6-4aff-81a8-97ef70afd102 {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:36:08.269714 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f4840eaf-90e4-4e63-8c7d-a90e65849800 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments/295f027e-4cb6-4aff-81a8-97ef70afd102" status: 404 len: 154 microversion: 2.1 time: 0.104320 Jun 04 18:36:08.269714 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 332/642] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:36:08 2022] DELETE /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13/os-volume_attachments/295f027e-4cb6-4aff-81a8-97ef70afd102 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:36:08.911079 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4c65ece4-d99d-48e5-bf13-715e211c4912 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:08.911685 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4c65ece4-d99d-48e5-bf13-715e211c4912 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:08.918141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4c65ece4-d99d-48e5-bf13-715e211c4912 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:08.918588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4c65ece4-d99d-48e5-bf13-715e211c4912 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:08.919389 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4c65ece4-d99d-48e5-bf13-715e211c4912 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:08.919811 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4c65ece4-d99d-48e5-bf13-715e211c4912 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:09.055769 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4c65ece4-d99d-48e5-bf13-715e211c4912 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:09.067053 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4c65ece4-d99d-48e5-bf13-715e211c4912 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1555 microversion: 2.1 time: 0.160246 Jun 04 18:36:09.067861 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 311/643] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:08 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:09.087858 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5ed3ece0-8601-4f1f-8760-aa824fac2435 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:09.088414 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5ed3ece0-8601-4f1f-8760-aa824fac2435 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:09.095187 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ed3ece0-8601-4f1f-8760-aa824fac2435 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:09.095668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ed3ece0-8601-4f1f-8760-aa824fac2435 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:09.096995 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ed3ece0-8601-4f1f-8760-aa824fac2435 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:09.097437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ed3ece0-8601-4f1f-8760-aa824fac2435 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:09.185095 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5ed3ece0-8601-4f1f-8760-aa824fac2435 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101127 Jun 04 18:36:09.185741 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 333/644] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 4 18:36:09 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:09.415592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3172f898-92fa-4554-a336-51e4b9d1d920 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:09.416126 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3172f898-92fa-4554-a336-51e4b9d1d920 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:09.422998 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3172f898-92fa-4554-a336-51e4b9d1d920 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:09.423444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3172f898-92fa-4554-a336-51e4b9d1d920 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:09.424288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3172f898-92fa-4554-a336-51e4b9d1d920 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:09.424736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3172f898-92fa-4554-a336-51e4b9d1d920 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:09.449685 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3172f898-92fa-4554-a336-51e4b9d1d920 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:36:09.539046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3172f898-92fa-4554-a336-51e4b9d1d920 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 204 len: 0 microversion: 2.1 time: 0.127094 Jun 04 18:36:09.539591 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 312/645] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:36:09 2022] DELETE /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:36:09.548987 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-86d1ec2a-3ddc-4091-b17b-406ad9c08ea5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:09.549624 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-86d1ec2a-3ddc-4091-b17b-406ad9c08ea5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:09.555779 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-86d1ec2a-3ddc-4091-b17b-406ad9c08ea5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:09.556267 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-86d1ec2a-3ddc-4091-b17b-406ad9c08ea5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:09.557044 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-86d1ec2a-3ddc-4091-b17b-406ad9c08ea5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:09.557479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-86d1ec2a-3ddc-4091-b17b-406ad9c08ea5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:09.756162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-86d1ec2a-3ddc-4091-b17b-406ad9c08ea5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:09.768535 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-86d1ec2a-3ddc-4091-b17b-406ad9c08ea5 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1553 microversion: 2.1 time: 0.223548 Jun 04 18:36:09.769123 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 334/646] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:09 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:10.222871 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-2ee79782-0368-4539-9b15-c3e19e6b4c6b req-e46e996c-f92a-4988-92ba-5c4dd801bc86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b570f772-6dc1-446e-9bdb-4368b8e409b4", "tag": "6bfff902-7d99-4486-bc8e-075cd1d5cd14"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:10.231219 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-2ee79782-0368-4539-9b15-c3e19e6b4c6b req-e46e996c-f92a-4988-92ba-5c4dd801bc86 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:10.231656 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-2ee79782-0368-4539-9b15-c3e19e6b4c6b req-e46e996c-f92a-4988-92ba-5c4dd801bc86 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:10.243105 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-2ee79782-0368-4539-9b15-c3e19e6b4c6b req-e46e996c-f92a-4988-92ba-5c4dd801bc86 service nova] Creating event network-changed:6bfff902-7d99-4486-bc8e-075cd1d5cd14 for instance b570f772-6dc1-446e-9bdb-4368b8e409b4 on hv-cinder-79053 Jun 04 18:36:10.248099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-2ee79782-0368-4539-9b15-c3e19e6b4c6b req-e46e996c-f92a-4988-92ba-5c4dd801bc86 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029253 Jun 04 18:36:10.248695 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 313/647] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:10.788321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-51c7ce15-d42d-4cda-a494-9b764e65df80 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:10.788908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-51c7ce15-d42d-4cda-a494-9b764e65df80 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:10.795838 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51c7ce15-d42d-4cda-a494-9b764e65df80 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:10.796319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51c7ce15-d42d-4cda-a494-9b764e65df80 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:10.797115 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51c7ce15-d42d-4cda-a494-9b764e65df80 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:10.797533 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51c7ce15-d42d-4cda-a494-9b764e65df80 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:10.929113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-51c7ce15-d42d-4cda-a494-9b764e65df80 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:10.937186 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-51c7ce15-d42d-4cda-a494-9b764e65df80 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1553 microversion: 2.1 time: 0.153185 Jun 04 18:36:10.937768 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 335/648] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:10 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:11.956200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-66de1df3-b4c9-489b-912b-f539ba133313 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:11.956907 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-66de1df3-b4c9-489b-912b-f539ba133313 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:11.963523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-66de1df3-b4c9-489b-912b-f539ba133313 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:11.963974 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-66de1df3-b4c9-489b-912b-f539ba133313 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:11.964781 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-66de1df3-b4c9-489b-912b-f539ba133313 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:11.965218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-66de1df3-b4c9-489b-912b-f539ba133313 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:12.178773 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-66de1df3-b4c9-489b-912b-f539ba133313 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e0bd04828eb48bdbfe09fd01130ac73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfb3750227e4037b6e92552361366f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:12.195093 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-66de1df3-b4c9-489b-912b-f539ba133313 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 200 len: 1553 microversion: 2.1 time: 0.242207 Jun 04 18:36:12.196162 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 314/649] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:11 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:12.229633 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-a8afc617-094a-454a-a1a4-1d9328616d25 req-0567dee9-cc18-4067-ba93-65bbb62ab551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e974c3d-7f67-46b4-91cf-27b8c2db1b13", "name": "network-vif-deleted", "tag": "6dd02dd3-7f7a-45a5-b6b6-da67814319b2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:12.238908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-a8afc617-094a-454a-a1a4-1d9328616d25 req-0567dee9-cc18-4067-ba93-65bbb62ab551 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:12.239449 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-a8afc617-094a-454a-a1a4-1d9328616d25 req-0567dee9-cc18-4067-ba93-65bbb62ab551 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:12.251379 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-a8afc617-094a-454a-a1a4-1d9328616d25 req-0567dee9-cc18-4067-ba93-65bbb62ab551 service nova] Creating event network-vif-deleted:6dd02dd3-7f7a-45a5-b6b6-da67814319b2 for instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 on hv-cinder-79053 Jun 04 18:36:12.257037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-a8afc617-094a-454a-a1a4-1d9328616d25 req-0567dee9-cc18-4067-ba93-65bbb62ab551 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030996 Jun 04 18:36:12.257670 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 336/650] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:12.575616 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f0ce6fe9-d0b2-43c3-b41e-d092d8e74f55 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:12.576648 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f0ce6fe9-d0b2-43c3-b41e-d092d8e74f55 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:12.584104 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f0ce6fe9-d0b2-43c3-b41e-d092d8e74f55 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:12.584746 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f0ce6fe9-d0b2-43c3-b41e-d092d8e74f55 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:12.585326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f0ce6fe9-d0b2-43c3-b41e-d092d8e74f55 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:12.585758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f0ce6fe9-d0b2-43c3-b41e-d092d8e74f55 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:12.617707 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f0ce6fe9-d0b2-43c3-b41e-d092d8e74f55 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046090 Jun 04 18:36:12.618276 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 315/651] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:36:12 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:36:12.681800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a1ac2aa0-fc51-426d-85a8-796f303c3b91 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:12.682488 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a1ac2aa0-fc51-426d-85a8-796f303c3b91 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:12.689188 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a1ac2aa0-fc51-426d-85a8-796f303c3b91 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:12.689729 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a1ac2aa0-fc51-426d-85a8-796f303c3b91 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:12.690571 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a1ac2aa0-fc51-426d-85a8-796f303c3b91 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:12.691127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a1ac2aa0-fc51-426d-85a8-796f303c3b91 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:12.719004 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a1ac2aa0-fc51-426d-85a8-796f303c3b91 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:36:12.799767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a1ac2aa0-fc51-426d-85a8-796f303c3b91 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "DELETE /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 204 len: 0 microversion: 2.1 time: 0.122251 Jun 04 18:36:12.800427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 337/652] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:36:12 2022] DELETE /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:36:12.809549 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-97e2f92b-72ce-46b7-af5e-504a039580e6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:12.810068 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-97e2f92b-72ce-46b7-af5e-504a039580e6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:12.816251 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97e2f92b-72ce-46b7-af5e-504a039580e6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:12.816708 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97e2f92b-72ce-46b7-af5e-504a039580e6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:12.817483 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97e2f92b-72ce-46b7-af5e-504a039580e6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:12.817918 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97e2f92b-72ce-46b7-af5e-504a039580e6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:12.957267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-97e2f92b-72ce-46b7-af5e-504a039580e6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:12.965515 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-97e2f92b-72ce-46b7-af5e-504a039580e6 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1672 microversion: 2.1 time: 0.159909 Jun 04 18:36:12.966079 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 316/653] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:12 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:13.215105 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:13.215804 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] [instance: 4e974c3d-7f67-46b4-91cf-27b8c2db1b13] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:13.222457 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:13.222889 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:13.223677 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:13.224140 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:13.238902 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] HTTP exception thrown: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 could not be found. Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Request method failure captured: Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 HTTP/1.1 Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6ULATe9giPkXVwWCkpyGxVv8q8doxW-Qi37K8Ht-2VH54U05kaApHuEVxcCTxt8CbjIVXjEoX7e7dHjKxgE1kWZrDCqMe7l_2OgWASKQJskn6jGNIHm_6Qj022CtXblMGRlsoB2RvO05s6TsEdfKqNRGOKWXc-itQFKIZca-PInLNs Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 5cfb3750227e4037b6e92552361366f4 Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-TestMinimumBasicScenario-1724516499 Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:36:13.240559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cfb3750227e4037b6e92552361366f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5cfb3750227e4037b6e92552361366f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5cfb3750227e4037b6e92552361366f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cfb3750227e4037b6e92552361366f4"}]}] Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-TestMinimumBasicScenario-1724516499 Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 5cfb3750227e4037b6e92552361366f4 Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1724516499 Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-TestMinimumBasicScenario-1724516499-project Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 2e0bd04828eb48bdbfe09fd01130ac73 Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-TestMinimumBasicScenario-1724516499-project Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 could not be found. Jun 04 18:36:13.242000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '4e974c3d-7f67-46b4-91cf-27b8c2db1b13'} Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 could not be found. Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:36:13.242949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 could not be found. Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 could not be found. Jun 04 18:36:13.244467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:13.245836 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Returning 404 to user: Instance 4e974c3d-7f67-46b4-91cf-27b8c2db1b13 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:36:13.245836 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0b2efe99-4f92-4d06-9bf8-14baa2bfbc2d tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13" status: 404 len: 111 microversion: 2.1 time: 0.032074 Jun 04 18:36:13.245836 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 338/654] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:13 2022] GET /compute/v2.1/servers/4e974c3d-7f67-46b4-91cf-27b8c2db1b13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:36:13.253315 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-85b505fd-7c58-4d12-83b8-a93073bb0447 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] Calling method '.version_select at 0x7f467df9b430>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:13.275430 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-85b505fd-7c58-4d12-83b8-a93073bb0447 tempest-TestMinimumBasicScenario-1724516499 tempest-TestMinimumBasicScenario-1724516499-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-191988361" status: 202 len: 0 microversion: 2.1 time: 0.028315 Jun 04 18:36:13.276031 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 317/655] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 4 18:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-191988361 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:36:13.986097 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1eb51f93-fa69-4e30-bea4-9ae91a54d88f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:13.987446 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1eb51f93-fa69-4e30-bea4-9ae91a54d88f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:13.990204 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:13.995631 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1eb51f93-fa69-4e30-bea4-9ae91a54d88f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:13.996116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1eb51f93-fa69-4e30-bea4-9ae91a54d88f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:13.996903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1eb51f93-fa69-4e30-bea4-9ae91a54d88f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:13.997342 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1eb51f93-fa69-4e30-bea4-9ae91a54d88f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:14.218898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1eb51f93-fa69-4e30-bea4-9ae91a54d88f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:14.229619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1eb51f93-fa69-4e30-bea4-9ae91a54d88f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1672 microversion: 2.1 time: 0.247511 Jun 04 18:36:14.230169 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 339/656] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:13 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:14.401847 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-521b693e-4ba7-48a3-b596-3aac84405c63 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:14.403609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-521b693e-4ba7-48a3-b596-3aac84405c63 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:14.407903 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:14.413836 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-521b693e-4ba7-48a3-b596-3aac84405c63 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:14.414644 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-521b693e-4ba7-48a3-b596-3aac84405c63 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:14.416819 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-521b693e-4ba7-48a3-b596-3aac84405c63 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:14.417456 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-521b693e-4ba7-48a3-b596-3aac84405c63 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:14.510763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-521b693e-4ba7-48a3-b596-3aac84405c63 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lazy-loading 'services' on Instance uuid 989409f2-e7e3-4010-b525-e7389d3eb160 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:36:14.594640 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-521b693e-4ba7-48a3-b596-3aac84405c63 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments/d0519c5a-05c6-4887-b2f6-9105c919d34b" status: 202 len: 0 microversion: 2.1 time: 0.197307 Jun 04 18:36:14.596701 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 318/657] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:36:14 2022] DELETE /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments/d0519c5a-05c6-4887-b2f6-9105c919d34b => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:36:14.608221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a9efe723-51fb-4d4c-8720-c478c2faf12b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:14.609186 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a9efe723-51fb-4d4c-8720-c478c2faf12b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:14.622733 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9efe723-51fb-4d4c-8720-c478c2faf12b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:14.623083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9efe723-51fb-4d4c-8720-c478c2faf12b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:14.623865 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9efe723-51fb-4d4c-8720-c478c2faf12b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:14.624326 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9efe723-51fb-4d4c-8720-c478c2faf12b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:14.668197 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a9efe723-51fb-4d4c-8720-c478c2faf12b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065356 Jun 04 18:36:14.668988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 340/658] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:36:14 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:15.173824 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-e17dd27b-05fe-4050-b501-79bbc67d9117 req-cb8992ac-800d-4df3-be51-77fbb4aa7b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ac4261-d93e-474e-84f7-9941b02a97c3", "name": "network-vif-deleted", "tag": "dceed2f4-0207-4e67-bd10-c14cc090441a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:15.200760 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e17dd27b-05fe-4050-b501-79bbc67d9117 req-cb8992ac-800d-4df3-be51-77fbb4aa7b4b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:15.201871 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e17dd27b-05fe-4050-b501-79bbc67d9117 req-cb8992ac-800d-4df3-be51-77fbb4aa7b4b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:15.224210 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-e17dd27b-05fe-4050-b501-79bbc67d9117 req-cb8992ac-800d-4df3-be51-77fbb4aa7b4b service nova] Creating event network-vif-deleted:dceed2f4-0207-4e67-bd10-c14cc090441a for instance 84ac4261-d93e-474e-84f7-9941b02a97c3 on hv-cinder-79053 Jun 04 18:36:15.238432 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-e17dd27b-05fe-4050-b501-79bbc67d9117 req-cb8992ac-800d-4df3-be51-77fbb4aa7b4b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072193 Jun 04 18:36:15.245552 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 319/659] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:15.256650 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9a377326-69a3-43c3-961b-23ebd104ed46 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:15.257564 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9a377326-69a3-43c3-961b-23ebd104ed46 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:15.266127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a377326-69a3-43c3-961b-23ebd104ed46 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:15.266839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a377326-69a3-43c3-961b-23ebd104ed46 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:15.267899 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a377326-69a3-43c3-961b-23ebd104ed46 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:15.268597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9a377326-69a3-43c3-961b-23ebd104ed46 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:15.412183 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9a377326-69a3-43c3-961b-23ebd104ed46 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:15.425988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9a377326-69a3-43c3-961b-23ebd104ed46 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 200 len: 1321 microversion: 2.1 time: 0.182420 Jun 04 18:36:15.437125 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 341/660] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:15 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:15.681926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-562395f8-2640-4b9a-93e1-4224264c6efc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:15.684165 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-562395f8-2640-4b9a-93e1-4224264c6efc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:15.694024 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-562395f8-2640-4b9a-93e1-4224264c6efc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:15.694686 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-562395f8-2640-4b9a-93e1-4224264c6efc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:15.704731 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-562395f8-2640-4b9a-93e1-4224264c6efc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:15.711692 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-562395f8-2640-4b9a-93e1-4224264c6efc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:15.773533 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-562395f8-2640-4b9a-93e1-4224264c6efc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098201 Jun 04 18:36:15.774937 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 320/661] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:36:15 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:36:15.898455 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-91993b9d-2cc8-42af-8a39-4baea570c740 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:15.899037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-91993b9d-2cc8-42af-8a39-4baea570c740 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:15.909471 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-91993b9d-2cc8-42af-8a39-4baea570c740 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:15.911065 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-91993b9d-2cc8-42af-8a39-4baea570c740 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:15.912169 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-91993b9d-2cc8-42af-8a39-4baea570c740 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:15.913463 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-91993b9d-2cc8-42af-8a39-4baea570c740 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:15.944801 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-91993b9d-2cc8-42af-8a39-4baea570c740 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:36:16.057354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-91993b9d-2cc8-42af-8a39-4baea570c740 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 204 len: 0 microversion: 2.1 time: 0.164088 Jun 04 18:36:16.057942 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 342/662] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:36:15 2022] DELETE /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 18:36:16.071659 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-948aad20-0665-449c-ad49-a4a2210f762e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:16.073207 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-948aad20-0665-449c-ad49-a4a2210f762e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:16.081693 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-948aad20-0665-449c-ad49-a4a2210f762e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:16.082531 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-948aad20-0665-449c-ad49-a4a2210f762e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:16.083807 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-948aad20-0665-449c-ad49-a4a2210f762e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:16.084401 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-948aad20-0665-449c-ad49-a4a2210f762e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:16.328362 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-948aad20-0665-449c-ad49-a4a2210f762e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:16.336908 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-948aad20-0665-449c-ad49-a4a2210f762e tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1690 microversion: 2.1 time: 0.272556 Jun 04 18:36:16.340964 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 321/663] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:16 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1690 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:16.444765 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:16.456121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:16.463096 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:16.463626 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:16.464600 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:16.465102 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:16.479013 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] HTTP exception thrown: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Request method failure captured: Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 HTTP/1.1 Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6Rq65JXOs6EZ0fhkc8vCyfJWKAqpL9g0zyONQ1BNzSQGqoii_htSz_A9L6ImtAQ6rLInn5JfMW9TYwePEfBGn1X5vdS77FMvkvmpoDCBm-yMrTftKCM45mF-Ai5_O7G923MCaEZa4sAOff2lVJV7QdGoQzMOj19C0KEfEawqc3Zz9A Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:36:16.480971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}] Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: bbb6c8f984d645dda88e2744f62a5213 Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:36:16.482246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '84ac4261-d93e-474e-84f7-9941b02a97c3'} Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:36:16.483025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:36:16.484220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:16.485294 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Returning 404 to user: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:36:16.485294 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cb5bb350-e9b5-4cae-9bc9-e06d0e9e94a1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 404 len: 111 microversion: 2.1 time: 0.043276 Jun 04 18:36:16.485294 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 343/664] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:16 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 18:36:16.491380 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-99172112-aeeb-4dad-a891-922f220917d9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '.version_select at 0x7f467df408b0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:16.510418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-99172112-aeeb-4dad-a891-922f220917d9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-566453212" status: 202 len: 0 microversion: 2.1 time: 0.022836 Jun 04 18:36:16.511093 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 322/665] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 4 18:36:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-566453212 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:36:17.361124 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e8f9cda2-6b37-4cf0-84dd-55dff9edfb69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:17.365574 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e8f9cda2-6b37-4cf0-84dd-55dff9edfb69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:17.372215 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8f9cda2-6b37-4cf0-84dd-55dff9edfb69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:17.380769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8f9cda2-6b37-4cf0-84dd-55dff9edfb69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:17.381865 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8f9cda2-6b37-4cf0-84dd-55dff9edfb69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:17.382302 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8f9cda2-6b37-4cf0-84dd-55dff9edfb69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:17.443940 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-32590116-1ae2-43fd-9b0b-efc75d53ea4e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'create', calling method: .version_select at 0x7f467df0e700>, body: {"keypair": {"name": "tempest-keypair-1162446738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvW/7AgWuaNzUR5n1EFmM6iTaxbjOy/HB9x7Dk4xyTutGDgRVjiZw0d4YWGCd46LBFuPLHBu4Ra0fBz6AjWi2qdq37KbqXtgJmKW9ju6fEQxBJIgJslWDxWIs9eOrN5Pg=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:17.472958 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-32590116-1ae2-43fd-9b0b-efc75d53ea4e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Getting quotas for project 4a74defc69084b06b8d6300d1ce15bc5. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:36:17.479217 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-32590116-1ae2-43fd-9b0b-efc75d53ea4e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Getting quotas for user bbb6c8f984d645dda88e2744f62a5213 and project 4a74defc69084b06b8d6300d1ce15bc5. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:36:17.536646 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-32590116-1ae2-43fd-9b0b-efc75d53ea4e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096130 Jun 04 18:36:17.540414 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 323/666] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:36:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:17.598765 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e8f9cda2-6b37-4cf0-84dd-55dff9edfb69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:17.620672 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e8f9cda2-6b37-4cf0-84dd-55dff9edfb69 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1690 microversion: 2.1 time: 0.263147 Jun 04 18:36:17.622146 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 344/667] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:17 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:18.638823 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5b8c0c37-6b72-46a3-88ca-27f71e7adfee tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:18.640058 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5b8c0c37-6b72-46a3-88ca-27f71e7adfee tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:18.647105 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b8c0c37-6b72-46a3-88ca-27f71e7adfee tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:18.647860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b8c0c37-6b72-46a3-88ca-27f71e7adfee tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:18.648651 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b8c0c37-6b72-46a3-88ca-27f71e7adfee tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:18.649275 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b8c0c37-6b72-46a3-88ca-27f71e7adfee tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:18.882464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5b8c0c37-6b72-46a3-88ca-27f71e7adfee tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:18.897921 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5b8c0c37-6b72-46a3-88ca-27f71e7adfee tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1690 microversion: 2.1 time: 0.262927 Jun 04 18:36:18.898687 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 324/668] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:18 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:19.045486 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-551470413", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc7986cb-2ff2-4f08-a9be-30c9595330e4"}], "security_groups": [{"name": "tempest-securitygroup--393922633"}], "key_name": "tempest-keypair-1162446738", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:19.212403 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] validate_networks() for [('dc7986cb-2ff2-4f08-a9be-30c9595330e4', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:36:19.668179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:36:19.669047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:36:19.669752 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:36:19.670318 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:36:19.670879 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:36:19.680257 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:19.680944 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:19.681905 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:19.682502 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:19.700930 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Getting quotas for project 4a74defc69084b06b8d6300d1ce15bc5. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:36:19.704909 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Getting quotas for user bbb6c8f984d645dda88e2744f62a5213 and project 4a74defc69084b06b8d6300d1ce15bc5. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:36:19.716217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:36:19.718586 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:36:19.769230 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7eb13872-3369-4144-8629-fa406d1e0d3a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728118 Jun 04 18:36:19.769918 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 345/669] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:36:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:36:19.780296 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-299b48d3-5a63-4860-a8c3-61e9bdfce095 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:19.781577 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-299b48d3-5a63-4860-a8c3-61e9bdfce095 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:19.916574 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-aa2b7441-1121-4d43-a2f9-da248f18decc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:19.917207 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-aa2b7441-1121-4d43-a2f9-da248f18decc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:19.923803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aa2b7441-1121-4d43-a2f9-da248f18decc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:19.924317 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aa2b7441-1121-4d43-a2f9-da248f18decc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:19.925277 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aa2b7441-1121-4d43-a2f9-da248f18decc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:19.925728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aa2b7441-1121-4d43-a2f9-da248f18decc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:20.069958 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-aa2b7441-1121-4d43-a2f9-da248f18decc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:20.079059 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-aa2b7441-1121-4d43-a2f9-da248f18decc tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1690 microversion: 2.1 time: 0.166761 Jun 04 18:36:20.080328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 346/670] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:19 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:36:20.106253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-299b48d3-5a63-4860-a8c3-61e9bdfce095 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:20.113961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-299b48d3-5a63-4860-a8c3-61e9bdfce095 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1237 microversion: 2.1 time: 0.337517 Jun 04 18:36:20.125146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 325/671] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:19 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1237 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:21.098101 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6d3143d8-e878-47c9-8f79-d423a5ffcb5f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:21.098719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6d3143d8-e878-47c9-8f79-d423a5ffcb5f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:21.105697 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6d3143d8-e878-47c9-8f79-d423a5ffcb5f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:21.106376 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6d3143d8-e878-47c9-8f79-d423a5ffcb5f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:21.107149 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6d3143d8-e878-47c9-8f79-d423a5ffcb5f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:21.107583 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6d3143d8-e878-47c9-8f79-d423a5ffcb5f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:21.132421 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c645a021-03ae-43cc-98f6-41e7acf45de4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:21.133891 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c645a021-03ae-43cc-98f6-41e7acf45de4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:21.148826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c645a021-03ae-43cc-98f6-41e7acf45de4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:21.149271 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c645a021-03ae-43cc-98f6-41e7acf45de4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:21.150056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c645a021-03ae-43cc-98f6-41e7acf45de4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:21.150490 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c645a021-03ae-43cc-98f6-41e7acf45de4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:21.245580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c645a021-03ae-43cc-98f6-41e7acf45de4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:21.256297 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c645a021-03ae-43cc-98f6-41e7acf45de4 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1295 microversion: 2.1 time: 0.127683 Jun 04 18:36:21.257618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 326/672] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:21 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1295 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:21.362508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6d3143d8-e878-47c9-8f79-d423a5ffcb5f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:21.372298 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6d3143d8-e878-47c9-8f79-d423a5ffcb5f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 200 len: 1622 microversion: 2.1 time: 0.278621 Jun 04 18:36:21.380873 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 347/673] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:21 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 1622 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:36:21.473023 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-1e919269-828b-4a04-9dda-d6fc98e38e8c req-993f5612-2396-47b2-8938-18c7be5b1731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989409f2-e7e3-4010-b525-e7389d3eb160", "name": "network-vif-deleted", "tag": "567a5b78-fc36-4e1e-ac0f-a5278d2fcb79"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:21.495874 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-1e919269-828b-4a04-9dda-d6fc98e38e8c req-993f5612-2396-47b2-8938-18c7be5b1731 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:21.496434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-1e919269-828b-4a04-9dda-d6fc98e38e8c req-993f5612-2396-47b2-8938-18c7be5b1731 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:21.522674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-1e919269-828b-4a04-9dda-d6fc98e38e8c req-993f5612-2396-47b2-8938-18c7be5b1731 service nova] Creating event network-vif-deleted:567a5b78-fc36-4e1e-ac0f-a5278d2fcb79 for instance 989409f2-e7e3-4010-b525-e7389d3eb160 on hv-cinder-79053 Jun 04 18:36:21.534149 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-1e919269-828b-4a04-9dda-d6fc98e38e8c req-993f5612-2396-47b2-8938-18c7be5b1731 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067280 Jun 04 18:36:21.536046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 327/674] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:22.280435 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2326ac34-a427-4f83-8129-cf025684c876 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:22.280435 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2326ac34-a427-4f83-8129-cf025684c876 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:22.286933 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2326ac34-a427-4f83-8129-cf025684c876 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:22.287361 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2326ac34-a427-4f83-8129-cf025684c876 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:22.288363 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2326ac34-a427-4f83-8129-cf025684c876 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:22.289007 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2326ac34-a427-4f83-8129-cf025684c876 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:22.310374 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:22.383169 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2326ac34-a427-4f83-8129-cf025684c876 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:22.392908 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2326ac34-a427-4f83-8129-cf025684c876 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1295 microversion: 2.1 time: 0.117252 Jun 04 18:36:22.399909 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 348/675] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:22 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1295 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:22.401670 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:22.403447 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 989409f2-e7e3-4010-b525-e7389d3eb160] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:22.411051 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:22.411587 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:22.412392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:22.412819 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:22.426873 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] HTTP exception thrown: Instance 989409f2-e7e3-4010-b525-e7389d3eb160 could not be found. Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Request method failure captured: Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 HTTP/1.1 Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6RqS-9onUVAQGG50nh-ykJv3ebxr_uOLOGJQQGXHZ5PcA_dRtSeaxeAuLuD9LWANPONJYjTDzvX1VgDiUyQ28PBykZ_enjmoLQV2epMvEDYXX0uhOleqqEw2dKqDYLppBBTJtYIzfeFJA9opK-PIEQeBWOWKHuFxG4JT2kOVxM-W5A Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:36:22.428595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}] Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 30f3cc8f3f964b96b864fc8a7f86481a Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 989409f2-e7e3-4010-b525-e7389d3eb160 could not be found. Jun 04 18:36:22.430190 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '989409f2-e7e3-4010-b525-e7389d3eb160'} Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 989409f2-e7e3-4010-b525-e7389d3eb160 could not be found. Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:36:22.431056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 989409f2-e7e3-4010-b525-e7389d3eb160 could not be found. Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 989409f2-e7e3-4010-b525-e7389d3eb160 could not be found. Jun 04 18:36:22.432449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:22.434376 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Returning 404 to user: Instance 989409f2-e7e3-4010-b525-e7389d3eb160 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:36:22.435377 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-73d654b5-1c43-40dc-b5ad-5409c5b4965d tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160" status: 404 len: 111 microversion: 2.1 time: 0.042750 Jun 04 18:36:22.436130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 328/676] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:22 2022] GET /compute/v2.1/servers/989409f2-e7e3-4010-b525-e7389d3eb160 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:36:22.444499 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-73e16575-3d19-4740-8ad8-b389aa888417 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '.version_select at 0x7f467de1b4c0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:22.465218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-73e16575-3d19-4740-8ad8-b389aa888417 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-340298638" status: 202 len: 0 microversion: 2.1 time: 0.024599 Jun 04 18:36:22.465837 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 349/677] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 4 18:36:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-340298638 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 18:36:23.411368 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8c1f8de2-91d1-46f4-9b47-7421a1e95e48 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:23.412039 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8c1f8de2-91d1-46f4-9b47-7421a1e95e48 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:23.425009 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8c1f8de2-91d1-46f4-9b47-7421a1e95e48 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:23.425508 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8c1f8de2-91d1-46f4-9b47-7421a1e95e48 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:23.428297 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8c1f8de2-91d1-46f4-9b47-7421a1e95e48 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:23.428751 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8c1f8de2-91d1-46f4-9b47-7421a1e95e48 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:23.660667 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-6792c834-74b6-4804-9792-c9f7a75a83c2 req-2223b0ed-c80f-47e5-971f-fd82c51ce338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e757cd-3a43-458f-b9da-341ebfcc1bae", "tag": "1d26581e-7d81-4913-9b38-a94dc05876e6"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:23.664181 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8c1f8de2-91d1-46f4-9b47-7421a1e95e48 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:23.669770 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:23.677595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8c1f8de2-91d1-46f4-9b47-7421a1e95e48 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1362 microversion: 2.1 time: 0.271324 Jun 04 18:36:23.678181 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 329/678] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:23 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:23.686915 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-6792c834-74b6-4804-9792-c9f7a75a83c2 req-2223b0ed-c80f-47e5-971f-fd82c51ce338 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:23.687368 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-6792c834-74b6-4804-9792-c9f7a75a83c2 req-2223b0ed-c80f-47e5-971f-fd82c51ce338 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:23.706765 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-6792c834-74b6-4804-9792-c9f7a75a83c2 req-2223b0ed-c80f-47e5-971f-fd82c51ce338 service nova] Creating event network-changed:1d26581e-7d81-4913-9b38-a94dc05876e6 for instance d5e757cd-3a43-458f-b9da-341ebfcc1bae on hv-cinder-79053 Jun 04 18:36:23.712988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-6792c834-74b6-4804-9792-c9f7a75a83c2 req-2223b0ed-c80f-47e5-971f-fd82c51ce338 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060743 Jun 04 18:36:23.713643 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 350/679] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:24.696309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-aaf777ef-33ed-4d81-b53d-e6ac50cf58ad tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:24.697857 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-aaf777ef-33ed-4d81-b53d-e6ac50cf58ad tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:24.708273 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aaf777ef-33ed-4d81-b53d-e6ac50cf58ad tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:24.708725 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aaf777ef-33ed-4d81-b53d-e6ac50cf58ad tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:24.709546 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aaf777ef-33ed-4d81-b53d-e6ac50cf58ad tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:24.710038 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aaf777ef-33ed-4d81-b53d-e6ac50cf58ad tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:24.841199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-aaf777ef-33ed-4d81-b53d-e6ac50cf58ad tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:24.849253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-aaf777ef-33ed-4d81-b53d-e6ac50cf58ad tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1362 microversion: 2.1 time: 0.158387 Jun 04 18:36:24.849747 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 330/680] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:24 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:25.772017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fa040356-123f-415b-9a6d-b87ab5e2dd3f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:25.772708 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fa040356-123f-415b-9a6d-b87ab5e2dd3f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:25.779552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa040356-123f-415b-9a6d-b87ab5e2dd3f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:25.780025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa040356-123f-415b-9a6d-b87ab5e2dd3f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:25.780794 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa040356-123f-415b-9a6d-b87ab5e2dd3f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:25.781230 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa040356-123f-415b-9a6d-b87ab5e2dd3f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:25.806659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fa040356-123f-415b-9a6d-b87ab5e2dd3f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:36:25.866986 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-980adb86-44a3-474d-8aea-cd34aec55c27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:25.867572 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-980adb86-44a3-474d-8aea-cd34aec55c27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:25.874157 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-980adb86-44a3-474d-8aea-cd34aec55c27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:25.874609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-980adb86-44a3-474d-8aea-cd34aec55c27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:25.875357 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-980adb86-44a3-474d-8aea-cd34aec55c27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:25.875795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-980adb86-44a3-474d-8aea-cd34aec55c27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:25.886425 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fa040356-123f-415b-9a6d-b87ab5e2dd3f tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 204 len: 0 microversion: 2.1 time: 0.118336 Jun 04 18:36:25.887132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 351/681] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:36:25 2022] DELETE /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:36:25.895388 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-90939a3e-6c39-49e1-984b-b39563a9c6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:25.896106 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-90939a3e-6c39-49e1-984b-b39563a9c6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:25.902073 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-90939a3e-6c39-49e1-984b-b39563a9c6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:25.902546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-90939a3e-6c39-49e1-984b-b39563a9c6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:25.903294 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-90939a3e-6c39-49e1-984b-b39563a9c6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:25.903729 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-90939a3e-6c39-49e1-984b-b39563a9c6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:26.012180 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-980adb86-44a3-474d-8aea-cd34aec55c27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:26.019780 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-980adb86-44a3-474d-8aea-cd34aec55c27 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1362 microversion: 2.1 time: 0.156858 Jun 04 18:36:26.020366 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 331/682] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:25 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:26.034965 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-90939a3e-6c39-49e1-984b-b39563a9c6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:26.042612 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-90939a3e-6c39-49e1-984b-b39563a9c6f7 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1509 microversion: 2.1 time: 0.151174 Jun 04 18:36:26.043172 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 352/683] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:25 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:36:27.037452 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02efc22b-5d1e-4696-b52e-ce37d1dc34dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:27.038145 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02efc22b-5d1e-4696-b52e-ce37d1dc34dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:27.045040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02efc22b-5d1e-4696-b52e-ce37d1dc34dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:27.045462 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02efc22b-5d1e-4696-b52e-ce37d1dc34dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:27.046225 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02efc22b-5d1e-4696-b52e-ce37d1dc34dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:27.046653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02efc22b-5d1e-4696-b52e-ce37d1dc34dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:27.060092 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7ef999f5-2d8f-4753-a825-726310ef2e38 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:27.060695 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7ef999f5-2d8f-4753-a825-726310ef2e38 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:27.067457 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ef999f5-2d8f-4753-a825-726310ef2e38 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:27.067912 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ef999f5-2d8f-4753-a825-726310ef2e38 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:27.068710 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ef999f5-2d8f-4753-a825-726310ef2e38 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:27.069365 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ef999f5-2d8f-4753-a825-726310ef2e38 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:27.179078 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02efc22b-5d1e-4696-b52e-ce37d1dc34dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:27.187381 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02efc22b-5d1e-4696-b52e-ce37d1dc34dd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1362 microversion: 2.1 time: 0.154191 Jun 04 18:36:27.187963 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 332/684] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:27 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:27.274994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7ef999f5-2d8f-4753-a825-726310ef2e38 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:27.284179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7ef999f5-2d8f-4753-a825-726310ef2e38 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 200 len: 1509 microversion: 2.1 time: 0.227512 Jun 04 18:36:27.284756 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 353/685] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:27 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:27.492584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-7983b398-d55a-4d22-8c8c-b5197a1b6fc5 req-78e79c97-74f5-4ed4-b4ab-eddee73386b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ade342-ad6d-48d1-909f-5f7530d99dbe", "name": "network-vif-deleted", "tag": "f05c89f1-fde1-490d-acf9-e0339f649264"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:27.501136 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-7983b398-d55a-4d22-8c8c-b5197a1b6fc5 req-78e79c97-74f5-4ed4-b4ab-eddee73386b8 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:27.501561 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-7983b398-d55a-4d22-8c8c-b5197a1b6fc5 req-78e79c97-74f5-4ed4-b4ab-eddee73386b8 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:27.513438 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-7983b398-d55a-4d22-8c8c-b5197a1b6fc5 req-78e79c97-74f5-4ed4-b4ab-eddee73386b8 service nova] Creating event network-vif-deleted:f05c89f1-fde1-490d-acf9-e0339f649264 for instance 43ade342-ad6d-48d1-909f-5f7530d99dbe on hv-cinder-79053 Jun 04 18:36:27.518565 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-7983b398-d55a-4d22-8c8c-b5197a1b6fc5 req-78e79c97-74f5-4ed4-b4ab-eddee73386b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029669 Jun 04 18:36:27.519257 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 333/686] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:28.205090 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-28c0ff46-3cda-4840-a56f-54924435242e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:28.205701 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-28c0ff46-3cda-4840-a56f-54924435242e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:28.212238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28c0ff46-3cda-4840-a56f-54924435242e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:28.212699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28c0ff46-3cda-4840-a56f-54924435242e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:28.213527 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28c0ff46-3cda-4840-a56f-54924435242e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:28.213901 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28c0ff46-3cda-4840-a56f-54924435242e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:28.302904 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:28.304365 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 43ade342-ad6d-48d1-909f-5f7530d99dbe] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:28.312104 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:28.312671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:28.313606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:28.314201 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:28.328430 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] HTTP exception thrown: Instance 43ade342-ad6d-48d1-909f-5f7530d99dbe could not be found. Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Request method failure captured: Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe HTTP/1.1 Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6RqS-9onUVAQGG50nh-ykJv3ebxr_uOLOGJQQGXHZ5PcA_dRtSeaxeAuLuD9LWANPONJYjTDzvX1VgDiUyQ28PBykZ_enjmoLQV2epMvEDYXX0uhOleqqEw2dKqDYLppBBTJtYIzfeFJA9opK-PIEQeBWOWKHuFxG4JT2kOVxM-W5A Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:36:28.330309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}] Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 30f3cc8f3f964b96b864fc8a7f86481a Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 43ade342-ad6d-48d1-909f-5f7530d99dbe could not be found. Jun 04 18:36:28.331816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '43ade342-ad6d-48d1-909f-5f7530d99dbe'} Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ade342-ad6d-48d1-909f-5f7530d99dbe could not be found. Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:36:28.332929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ade342-ad6d-48d1-909f-5f7530d99dbe could not be found. Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ade342-ad6d-48d1-909f-5f7530d99dbe could not be found. Jun 04 18:36:28.334262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:36:28.335429 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Returning 404 to user: Instance 43ade342-ad6d-48d1-909f-5f7530d99dbe could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:36:28.335429 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ee4088f4-dc43-4ad0-8a0e-d96f16534273 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe" status: 404 len: 111 microversion: 2.1 time: 0.034432 Jun 04 18:36:28.335429 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 334/687] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:28 2022] GET /compute/v2.1/servers/43ade342-ad6d-48d1-909f-5f7530d99dbe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 18:36:28.341258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-19462a70-a4fc-4c90-9c36-f2fb6c232813 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:28.341917 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-19462a70-a4fc-4c90-9c36-f2fb6c232813 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:28.348526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19462a70-a4fc-4c90-9c36-f2fb6c232813 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:28.348792 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19462a70-a4fc-4c90-9c36-f2fb6c232813 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:28.349554 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19462a70-a4fc-4c90-9c36-f2fb6c232813 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:28.350048 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-19462a70-a4fc-4c90-9c36-f2fb6c232813 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:28.364174 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-28c0ff46-3cda-4840-a56f-54924435242e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:28.372467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-28c0ff46-3cda-4840-a56f-54924435242e tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1362 microversion: 2.1 time: 0.171753 Jun 04 18:36:28.373030 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 354/688] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:28 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:28.380773 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-19462a70-a4fc-4c90-9c36-f2fb6c232813 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:36:28.465216 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-19462a70-a4fc-4c90-9c36-f2fb6c232813 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 204 len: 0 microversion: 2.1 time: 0.127352 Jun 04 18:36:28.465805 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 335/689] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:36:28 2022] DELETE /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:36:28.473870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bc32ecd5-114e-4ad4-8f2b-8f5fa5260566 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:28.474476 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bc32ecd5-114e-4ad4-8f2b-8f5fa5260566 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:28.481050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc32ecd5-114e-4ad4-8f2b-8f5fa5260566 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:28.481515 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc32ecd5-114e-4ad4-8f2b-8f5fa5260566 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:28.482283 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc32ecd5-114e-4ad4-8f2b-8f5fa5260566 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:28.482724 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc32ecd5-114e-4ad4-8f2b-8f5fa5260566 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:28.623523 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bc32ecd5-114e-4ad4-8f2b-8f5fa5260566 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:28.631259 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bc32ecd5-114e-4ad4-8f2b-8f5fa5260566 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1522 microversion: 2.1 time: 0.161281 Jun 04 18:36:28.632048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 355/690] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:28 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:29.390516 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f7f42ff2-6464-4006-9bf3-bb9c654cb627 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:29.391264 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f7f42ff2-6464-4006-9bf3-bb9c654cb627 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:29.398398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f7f42ff2-6464-4006-9bf3-bb9c654cb627 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:29.398924 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f7f42ff2-6464-4006-9bf3-bb9c654cb627 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:29.399763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f7f42ff2-6464-4006-9bf3-bb9c654cb627 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:29.400271 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f7f42ff2-6464-4006-9bf3-bb9c654cb627 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:29.533025 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f7f42ff2-6464-4006-9bf3-bb9c654cb627 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:29.541137 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f7f42ff2-6464-4006-9bf3-bb9c654cb627 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1362 microversion: 2.1 time: 0.155175 Jun 04 18:36:29.541721 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 336/691] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:29 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:29.646473 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-7067dbc2-39d0-450e-962b-7949e038aee9 req-11521fff-e536-42f5-9fe6-46e9f96c4ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b484f9b-4abe-452f-9b72-0be6e5f44785", "name": "network-vif-deleted", "tag": "3ed528b4-d466-4323-9818-85abaf4e3aff"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:29.648504 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-290b92b3-bb95-4c39-b979-8f3d063e2023 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:29.649239 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-290b92b3-bb95-4c39-b979-8f3d063e2023 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:29.655686 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-7067dbc2-39d0-450e-962b-7949e038aee9 req-11521fff-e536-42f5-9fe6-46e9f96c4ded service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:29.656174 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-7067dbc2-39d0-450e-962b-7949e038aee9 req-11521fff-e536-42f5-9fe6-46e9f96c4ded service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:29.662331 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-290b92b3-bb95-4c39-b979-8f3d063e2023 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:29.663253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-290b92b3-bb95-4c39-b979-8f3d063e2023 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:29.664822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-290b92b3-bb95-4c39-b979-8f3d063e2023 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:29.665234 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-290b92b3-bb95-4c39-b979-8f3d063e2023 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:29.669015 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-7067dbc2-39d0-450e-962b-7949e038aee9 req-11521fff-e536-42f5-9fe6-46e9f96c4ded service nova] Creating event network-vif-deleted:3ed528b4-d466-4323-9818-85abaf4e3aff for instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 on hv-cinder-79053 Jun 04 18:36:29.674366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-7067dbc2-39d0-450e-962b-7949e038aee9 req-11521fff-e536-42f5-9fe6-46e9f96c4ded service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031202 Jun 04 18:36:29.675669 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 356/692] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:29.751441 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-290b92b3-bb95-4c39-b979-8f3d063e2023 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f3cc8f3f964b96b864fc8a7f86481a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:29.761325 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-290b92b3-bb95-4c39-b979-8f3d063e2023 tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 200 len: 1307 microversion: 2.1 time: 0.116951 Jun 04 18:36:29.761893 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 337/693] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:29 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 1307 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:30.278051 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:30.278907 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:30.282889 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-d0531848-4ad0-4061-a8ec-d9d1b51e7cee req-49af7a22-633e-4b10-81c4-97dde3736ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e757cd-3a43-458f-b9da-341ebfcc1bae", "name": "network-vif-plugged", "status": "completed", "tag": "1d26581e-7d81-4913-9b38-a94dc05876e6"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:30.293530 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d0531848-4ad0-4061-a8ec-d9d1b51e7cee req-49af7a22-633e-4b10-81c4-97dde3736ff0 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:30.293530 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d0531848-4ad0-4061-a8ec-d9d1b51e7cee req-49af7a22-633e-4b10-81c4-97dde3736ff0 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:30.305033 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-d0531848-4ad0-4061-a8ec-d9d1b51e7cee req-49af7a22-633e-4b10-81c4-97dde3736ff0 service nova] Creating event network-vif-plugged:1d26581e-7d81-4913-9b38-a94dc05876e6 for instance d5e757cd-3a43-458f-b9da-341ebfcc1bae on hv-cinder-79053 Jun 04 18:36:30.310165 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-d0531848-4ad0-4061-a8ec-d9d1b51e7cee req-49af7a22-633e-4b10-81c4-97dde3736ff0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032883 Jun 04 18:36:30.310775 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 357/694] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:30.561144 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-73147b2f-ef7b-4df2-9f07-dcab03214594 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:30.561889 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-73147b2f-ef7b-4df2-9f07-dcab03214594 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:30.564478 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:30.573075 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-73147b2f-ef7b-4df2-9f07-dcab03214594 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:30.573790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-73147b2f-ef7b-4df2-9f07-dcab03214594 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:30.574823 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-73147b2f-ef7b-4df2-9f07-dcab03214594 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:30.575350 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-73147b2f-ef7b-4df2-9f07-dcab03214594 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:30.721953 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-73147b2f-ef7b-4df2-9f07-dcab03214594 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:30.730091 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-73147b2f-ef7b-4df2-9f07-dcab03214594 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1362 microversion: 2.1 time: 0.175225 Jun 04 18:36:30.730661 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 338/695] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:30 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:30.780800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:30.781662 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] [instance: 3b484f9b-4abe-452f-9b72-0be6e5f44785] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:30.791558 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:30.792244 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:30.793323 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:30.793937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:30.810424 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] HTTP exception thrown: Instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 could not be found. Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Request method failure captured: Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 HTTP/1.1 Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6RqS-9onUVAQGG50nh-ykJv3ebxr_uOLOGJQQGXHZ5PcA_dRtSeaxeAuLuD9LWANPONJYjTDzvX1VgDiUyQ28PBykZ_enjmoLQV2epMvEDYXX0uhOleqqEw2dKqDYLppBBTJtYIzfeFJA9opK-PIEQeBWOWKHuFxG4JT2kOVxM-W5A Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:36:30.812037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3c5011d10ed45c68dcfe77a09f6d9a1"}]}] Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: a3c5011d10ed45c68dcfe77a09f6d9a1 Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1231847436 Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 30f3cc8f3f964b96b864fc8a7f86481a Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1231847436-project Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 could not be found. Jun 04 18:36:30.813479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '3b484f9b-4abe-452f-9b72-0be6e5f44785'} Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 could not be found. Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:36:30.814512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 could not be found. Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 could not be found. Jun 04 18:36:30.816638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:36:30.818637 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] Returning 404 to user: Instance 3b484f9b-4abe-452f-9b72-0be6e5f44785 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:36:30.818637 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-72dc58fc-4a08-417c-8721-e67c809f224b tempest-ServerRescueNegativeTestJSON-1231847436 tempest-ServerRescueNegativeTestJSON-1231847436-project] 10.222.0.39 "GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785" status: 404 len: 111 microversion: 2.1 time: 0.039384 Jun 04 18:36:30.818637 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 358/696] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:30 2022] GET /compute/v2.1/servers/3b484f9b-4abe-452f-9b72-0be6e5f44785 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:36:31.748181 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9f6fc677-5230-4dc8-abc1-6a3f3cd9f0e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:31.748792 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9f6fc677-5230-4dc8-abc1-6a3f3cd9f0e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:31.756115 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9f6fc677-5230-4dc8-abc1-6a3f3cd9f0e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:31.756582 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9f6fc677-5230-4dc8-abc1-6a3f3cd9f0e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:31.757406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9f6fc677-5230-4dc8-abc1-6a3f3cd9f0e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:31.757849 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9f6fc677-5230-4dc8-abc1-6a3f3cd9f0e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:31.900097 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9f6fc677-5230-4dc8-abc1-6a3f3cd9f0e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:31.909710 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9f6fc677-5230-4dc8-abc1-6a3f3cd9f0e1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1362 microversion: 2.1 time: 0.165608 Jun 04 18:36:31.910289 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 339/697] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:31 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:32.926781 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2cb34613-d186-42e3-a35c-1f1ec437476b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:32.927521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2cb34613-d186-42e3-a35c-1f1ec437476b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:32.934662 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2cb34613-d186-42e3-a35c-1f1ec437476b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:32.935092 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2cb34613-d186-42e3-a35c-1f1ec437476b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:32.936062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2cb34613-d186-42e3-a35c-1f1ec437476b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:32.936513 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2cb34613-d186-42e3-a35c-1f1ec437476b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:33.166348 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2cb34613-d186-42e3-a35c-1f1ec437476b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:33.175610 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2cb34613-d186-42e3-a35c-1f1ec437476b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1549 microversion: 2.1 time: 0.252678 Jun 04 18:36:33.176276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 359/698] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:36:32 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1549 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:36:33.192092 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7dd91098-24e8-43dd-af2a-0bdeda296829 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:33.192636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7dd91098-24e8-43dd-af2a-0bdeda296829 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:33.199235 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7dd91098-24e8-43dd-af2a-0bdeda296829 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:33.199888 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7dd91098-24e8-43dd-af2a-0bdeda296829 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:33.200684 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7dd91098-24e8-43dd-af2a-0bdeda296829 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:33.201122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7dd91098-24e8-43dd-af2a-0bdeda296829 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:33.286017 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7dd91098-24e8-43dd-af2a-0bdeda296829 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097794 Jun 04 18:36:33.286606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 340/699] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 4 18:36:33 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:34.337395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-377eabbe-058e-4bb9-95b7-96029a7da07d req-935436ef-cf85-4073-a644-5c9160464e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e757cd-3a43-458f-b9da-341ebfcc1bae", "tag": "1d26581e-7d81-4913-9b38-a94dc05876e6"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:34.360264 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-377eabbe-058e-4bb9-95b7-96029a7da07d req-935436ef-cf85-4073-a644-5c9160464e0b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:34.365550 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-377eabbe-058e-4bb9-95b7-96029a7da07d req-935436ef-cf85-4073-a644-5c9160464e0b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:34.384248 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-377eabbe-058e-4bb9-95b7-96029a7da07d req-935436ef-cf85-4073-a644-5c9160464e0b service nova] Creating event network-changed:1d26581e-7d81-4913-9b38-a94dc05876e6 for instance d5e757cd-3a43-458f-b9da-341ebfcc1bae on hv-cinder-79053 Jun 04 18:36:34.389652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-377eabbe-058e-4bb9-95b7-96029a7da07d req-935436ef-cf85-4073-a644-5c9160464e0b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056128 Jun 04 18:36:34.390621 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 360/700] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:40.038836 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ec650b31-cb42-48fc-a159-2b0bc58a1cfb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'create', calling method: .version_select at 0x7f467df0eca0>, body: {"keypair": {"name": "tempest-keypair-1187799531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvJZh2P0oPA3sTSbfuuO+kmS7Nu8m+r4Sy8rDfYeQnsnadfaSTiHGbI7W4xPBNQwd4CWqMCOQO3l8VFEGCqFOS3Cn7PlYpaqTNaEReoul3FFr7L8YCNVqDOYXwUix8ohg=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:40.052766 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-ec650b31-cb42-48fc-a159-2b0bc58a1cfb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Getting quotas for project 1c1a5168618d4511a41baa4f25425b86. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:36:40.057130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-ec650b31-cb42-48fc-a159-2b0bc58a1cfb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Getting quotas for user 6ceccf3f6ce044b98503b09b13cd2510 and project 1c1a5168618d4511a41baa4f25425b86. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:36:40.082641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ec650b31-cb42-48fc-a159-2b0bc58a1cfb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.160348 Jun 04 18:36:40.083144 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 341/701] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 4 18:36:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 162 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 04 18:36:41.398143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-667658413", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "660a1442-fc81-45f2-ab4a-74a7caf0e179"}], "security_groups": [{"name": "tempest-securitygroup--1138891334"}], "key_name": "tempest-keypair-1187799531", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:41.502675 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] validate_networks() for [('660a1442-fc81-45f2-ab4a-74a7caf0e179', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:36:41.902201 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:36:41.902627 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:36:41.903103 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:36:41.903513 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:36:41.903922 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:36:41.914184 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:41.914570 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:41.915977 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:41.917395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:41.940352 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Getting quotas for project 1c1a5168618d4511a41baa4f25425b86. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:36:41.945267 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Getting quotas for user 6ceccf3f6ce044b98503b09b13cd2510 and project 1c1a5168618d4511a41baa4f25425b86. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:36:41.962112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:36:41.964549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:36:42.018723 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ceb40b59-26df-4cab-8523-b5b34e5f518f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.626435 Jun 04 18:36:42.020173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 361/702] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 4 18:36:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 18:36:42.030487 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b617f4c2-a00d-4551-ab36-ccb0aa02a92d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:42.031091 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b617f4c2-a00d-4551-ab36-ccb0aa02a92d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:42.093130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b617f4c2-a00d-4551-ab36-ccb0aa02a92d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:42.102468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b617f4c2-a00d-4551-ab36-ccb0aa02a92d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:42.107322 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b617f4c2-a00d-4551-ab36-ccb0aa02a92d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:42.108717 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b617f4c2-a00d-4551-ab36-ccb0aa02a92d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1281 microversion: 2.20 time: 0.082761 Jun 04 18:36:42.116550 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 342/703] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:42 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:43.129362 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:43.130347 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:43.138234 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:43.138942 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:43.140581 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:43.141195 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:43.224481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:43.240061 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:43.242042 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:43.243128 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-64a221d2-78da-4bcb-b8e7-363fabbd1a56 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1351 microversion: 2.20 time: 0.120016 Jun 04 18:36:43.243666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 362/704] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:43 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:44.262220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:44.262912 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:44.265299 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:44.271476 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:44.271986 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:44.272785 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:44.273212 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:44.427259 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:44.437547 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:44.439051 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:44.440197 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8af22c14-01e7-4e61-b554-7e5383b87947 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1407 microversion: 2.20 time: 0.182103 Jun 04 18:36:44.441107 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 343/705] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:44 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:44.576516 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-1f41d876-c6b3-469d-bb63-936b60697336 req-86cbab8a-784b-423d-89ff-43ea3820aa5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba7020d7-a1c8-41d2-8172-08a5c8438167", "tag": "c0785036-2e03-4588-a648-bccd3d33560a"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:44.585403 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:44.595412 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1f41d876-c6b3-469d-bb63-936b60697336 req-86cbab8a-784b-423d-89ff-43ea3820aa5c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:44.596045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1f41d876-c6b3-469d-bb63-936b60697336 req-86cbab8a-784b-423d-89ff-43ea3820aa5c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:44.609855 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-1f41d876-c6b3-469d-bb63-936b60697336 req-86cbab8a-784b-423d-89ff-43ea3820aa5c service nova] Creating event network-changed:c0785036-2e03-4588-a648-bccd3d33560a for instance ba7020d7-a1c8-41d2-8172-08a5c8438167 on hv-cinder-79053 Jun 04 18:36:44.615537 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-1f41d876-c6b3-469d-bb63-936b60697336 req-86cbab8a-784b-423d-89ff-43ea3820aa5c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048881 Jun 04 18:36:44.617405 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 363/706] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:36:45.464251 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:45.465150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:45.468835 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:45.477485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:45.478007 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:45.478788 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:45.479192 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:45.619058 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:45.630625 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:45.632732 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:45.633867 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7d417c68-7e39-4476-9044-f47e89022708 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1407 microversion: 2.20 time: 0.178257 Jun 04 18:36:45.634424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 344/707] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:45 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:46.657398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:46.658890 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:46.672753 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:46.673508 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:46.674772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:46.675501 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:46.820651 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:46.829277 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:46.830772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:46.831876 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ec36f619-5be1-42aa-a929-82125d42928e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1407 microversion: 2.20 time: 0.181736 Jun 04 18:36:46.832479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 364/708] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:46 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:47.853457 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:47.854086 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:47.861239 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:47.861680 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:47.862435 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:47.862864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:48.005523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:48.014238 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:48.015724 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:48.016855 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d6a63eff-58a9-418c-b5dd-2a41f4a85093 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1407 microversion: 2.20 time: 0.168917 Jun 04 18:36:48.017444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 345/709] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:47 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:49.041860 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:49.042854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:49.053803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:49.054460 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:49.055217 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:49.055647 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:49.204366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:49.212551 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:49.214040 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:49.215148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-15c57f62-2bda-4034-b6c9-4e56eefd60b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1407 microversion: 2.20 time: 0.180135 Jun 04 18:36:49.215705 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 365/710] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:49 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:50.234914 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:50.236075 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:50.243277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:50.243733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:50.244542 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:50.244996 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:50.319521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-e5934e20-fb8c-4862-9bb8-568e3176ba70 req-4b3de9f6-9bb5-4b8f-a85f-a4f60e0b7d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7020d7-a1c8-41d2-8172-08a5c8438167", "name": "network-vif-plugged", "status": "completed", "tag": "c0785036-2e03-4588-a648-bccd3d33560a"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:50.329441 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e5934e20-fb8c-4862-9bb8-568e3176ba70 req-4b3de9f6-9bb5-4b8f-a85f-a4f60e0b7d63 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:50.329852 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e5934e20-fb8c-4862-9bb8-568e3176ba70 req-4b3de9f6-9bb5-4b8f-a85f-a4f60e0b7d63 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:50.342179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-e5934e20-fb8c-4862-9bb8-568e3176ba70 req-4b3de9f6-9bb5-4b8f-a85f-a4f60e0b7d63 service nova] Creating event network-vif-plugged:c0785036-2e03-4588-a648-bccd3d33560a for instance ba7020d7-a1c8-41d2-8172-08a5c8438167 on hv-cinder-79053 Jun 04 18:36:50.347084 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-e5934e20-fb8c-4862-9bb8-568e3176ba70 req-4b3de9f6-9bb5-4b8f-a85f-a4f60e0b7d63 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031311 Jun 04 18:36:50.347732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 366/711] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:36:50.400281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:50.411861 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:50.415036 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:50.416416 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d9a7c356-c77a-402e-b0b0-dc7227a5c3ff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1407 microversion: 2.20 time: 0.186244 Jun 04 18:36:50.417112 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 346/712] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:50 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:51.440695 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:51.441701 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:51.449734 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:51.450176 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:51.450966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:51.451421 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:51.585540 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:51.598002 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:51.599966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:51.601493 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-08ab52cb-3563-4336-99d5-c4200d9e240c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1407 microversion: 2.20 time: 0.168872 Jun 04 18:36:51.602265 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 367/713] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:51 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:52.625836 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:52.626360 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:52.628727 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:52.634535 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:52.634983 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:52.635759 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:52.636224 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:52.779602 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:52.788211 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:52.789782 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:36:52.790884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0d246656-da54-4265-8077-488225a79b8c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1599 microversion: 2.20 time: 0.169438 Jun 04 18:36:52.791438 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 347/714] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:36:52 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:36:52.810466 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b1525906-1b8c-4c23-bab8-5f6bf3b15df3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:36:52.811237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b1525906-1b8c-4c23-bab8-5f6bf3b15df3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:36:52.813428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:52.814088 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:52.822985 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b1525906-1b8c-4c23-bab8-5f6bf3b15df3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:52.823429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b1525906-1b8c-4c23-bab8-5f6bf3b15df3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:52.824237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b1525906-1b8c-4c23-bab8-5f6bf3b15df3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:52.824674 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b1525906-1b8c-4c23-bab8-5f6bf3b15df3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:52.827306 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:52.910523 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b1525906-1b8c-4c23-bab8-5f6bf3b15df3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105675 Jun 04 18:36:52.911314 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 368/715] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 4 18:36:52 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:36:54.137607 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-b1a4540e-35b0-4044-bfcd-50559420c4c0 req-806c7428-9dee-4261-a32a-5d2775d15dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba7020d7-a1c8-41d2-8172-08a5c8438167", "tag": "c0785036-2e03-4588-a648-bccd3d33560a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:36:54.146294 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b1a4540e-35b0-4044-bfcd-50559420c4c0 req-806c7428-9dee-4261-a32a-5d2775d15dfb service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:36:54.146733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b1a4540e-35b0-4044-bfcd-50559420c4c0 req-806c7428-9dee-4261-a32a-5d2775d15dfb service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:36:54.159102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-b1a4540e-35b0-4044-bfcd-50559420c4c0 req-806c7428-9dee-4261-a32a-5d2775d15dfb service nova] Creating event network-changed:c0785036-2e03-4588-a648-bccd3d33560a for instance ba7020d7-a1c8-41d2-8172-08a5c8438167 on hv-cinder-79053 Jun 04 18:36:54.165177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-b1a4540e-35b0-4044-bfcd-50559420c4c0 req-806c7428-9dee-4261-a32a-5d2775d15dfb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030768 Jun 04 18:36:54.166317 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 348/716] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:25.193789 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=11 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:25.194819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:25.199179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-25d8ccfd-2a4b-496f-a50b-373a293d2375 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:25.199726 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-25d8ccfd-2a4b-496f-a50b-373a293d2375 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:25.209705 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25d8ccfd-2a4b-496f-a50b-373a293d2375 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:25.210456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25d8ccfd-2a4b-496f-a50b-373a293d2375 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:25.211755 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25d8ccfd-2a4b-496f-a50b-373a293d2375 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:25.212643 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25d8ccfd-2a4b-496f-a50b-373a293d2375 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:25.242135 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-25d8ccfd-2a4b-496f-a50b-373a293d2375 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/ips" status: 200 len: 150 microversion: 2.1 time: 0.049791 Jun 04 18:37:25.242715 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 369/717] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:37:25 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:26.587375 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-07a5dfb5-f6bf-478a-b806-64ba1d8e0e14 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1597adf9-a89e-40fb-aade-958d1d90a3bf"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:26.588580 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-07a5dfb5-f6bf-478a-b806-64ba1d8e0e14 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:26.590733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=9 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:26.591375 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=32 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:26.599621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-07a5dfb5-f6bf-478a-b806-64ba1d8e0e14 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:26.600287 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-07a5dfb5-f6bf-478a-b806-64ba1d8e0e14 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:26.601502 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-07a5dfb5-f6bf-478a-b806-64ba1d8e0e14 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:26.602095 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-07a5dfb5-f6bf-478a-b806-64ba1d8e0e14 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:26.878990 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-07a5dfb5-f6bf-478a-b806-64ba1d8e0e14 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295988 Jun 04 18:37:26.879621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 349/718] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:37:26 2022] POST /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:34.445047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1597adf9-a89e-40fb-aade-958d1d90a3bf"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:34.446036 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:34.452581 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:34.453058 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:34.454209 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:34.454442 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:34.533020 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Invalid volume: volume 1597adf9-a89e-40fb-aade-958d1d90a3bf is already attached to instances: b570f772-6dc1-446e-9bdb-4368b8e409b4 Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: POST /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments HTTP/1.1 Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 74 Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:37:34.534735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {"volumeAttachment": {"volumeId": "1597adf9-a89e-40fb-aade-958d1d90a3bf"}} Jun 04 18:37:34.536366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Invalid volume: volume 1597adf9-a89e-40fb-aade-958d1d90a3bf is already attached to instances: b570f772-6dc1-446e-9bdb-4368b8e409b4 Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'server_id': 'b570f772-6dc1-446e-9bdb-4368b8e409b4', 'body': {'volumeAttachment': {'volumeId': '1597adf9-a89e-40fb-aade-958d1d90a3bf'}}} Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1597adf9-a89e-40fb-aade-958d1d90a3bf is already attached to instances: b570f772-6dc1-446e-9bdb-4368b8e409b4 Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:37:34.537171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1597adf9-a89e-40fb-aade-958d1d90a3bf is already attached to instances: b570f772-6dc1-446e-9bdb-4368b8e409b4 Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:37:34.538330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:37:34.539546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:37:34.539546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:37:34.539546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:37:34.539546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1597adf9-a89e-40fb-aade-958d1d90a3bf is already attached to instances: b570f772-6dc1-446e-9bdb-4368b8e409b4 Jun 04 18:37:34.539546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:37:34.539546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 400 to user: Invalid volume: volume 1597adf9-a89e-40fb-aade-958d1d90a3bf is already attached to instances: b570f772-6dc1-446e-9bdb-4368b8e409b4 {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:37:34.539546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7bcf8be8-ae0b-4ee6-bc99-5c641a5c6d11 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095368 Jun 04 18:37:34.539546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 370/719] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:37:34 2022] POST /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:37:34.601328 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-215cdc9b-995f-4683-b8a9-46b2de244ebc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:34.601878 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-215cdc9b-995f-4683-b8a9-46b2de244ebc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:34.610790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-215cdc9b-995f-4683-b8a9-46b2de244ebc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:34.611230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-215cdc9b-995f-4683-b8a9-46b2de244ebc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:34.611990 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-215cdc9b-995f-4683-b8a9-46b2de244ebc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:34.612416 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-215cdc9b-995f-4683-b8a9-46b2de244ebc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:34.700830 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-215cdc9b-995f-4683-b8a9-46b2de244ebc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lazy-loading 'services' on Instance uuid b570f772-6dc1-446e-9bdb-4368b8e409b4 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:37:34.796265 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-215cdc9b-995f-4683-b8a9-46b2de244ebc tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments/1597adf9-a89e-40fb-aade-958d1d90a3bf" status: 202 len: 0 microversion: 2.1 time: 0.202766 Jun 04 18:37:34.796876 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 350/720] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:37:34 2022] DELETE /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments/1597adf9-a89e-40fb-aade-958d1d90a3bf => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:37:34.805603 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4b9583c9-6176-43b2-b278-1feafa436105 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:34.806760 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4b9583c9-6176-43b2-b278-1feafa436105 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:34.813544 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b9583c9-6176-43b2-b278-1feafa436105 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:34.813924 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b9583c9-6176-43b2-b278-1feafa436105 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:34.814708 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b9583c9-6176-43b2-b278-1feafa436105 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:34.815223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b9583c9-6176-43b2-b278-1feafa436105 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:34.846691 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4b9583c9-6176-43b2-b278-1feafa436105 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Jun 04 18:37:34.847324 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 371/721] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:37:34 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:35.862111 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-96c7d6c3-f7b8-48ce-a043-7f9b9910056e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:35.863081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-96c7d6c3-f7b8-48ce-a043-7f9b9910056e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:35.869828 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96c7d6c3-f7b8-48ce-a043-7f9b9910056e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:35.870304 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96c7d6c3-f7b8-48ce-a043-7f9b9910056e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:35.871070 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96c7d6c3-f7b8-48ce-a043-7f9b9910056e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:35.871500 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96c7d6c3-f7b8-48ce-a043-7f9b9910056e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:35.900451 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-96c7d6c3-f7b8-48ce-a043-7f9b9910056e tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044025 Jun 04 18:37:35.900994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 351/722] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:37:35 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:37:35.964030 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e48a39f9-cad2-4618-ac03-74aaf5f74165 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:35.964544 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e48a39f9-cad2-4618-ac03-74aaf5f74165 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:35.971229 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e48a39f9-cad2-4618-ac03-74aaf5f74165 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:35.971709 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e48a39f9-cad2-4618-ac03-74aaf5f74165 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:35.972471 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e48a39f9-cad2-4618-ac03-74aaf5f74165 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:35.972882 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e48a39f9-cad2-4618-ac03-74aaf5f74165 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:35.999451 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e48a39f9-cad2-4618-ac03-74aaf5f74165 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:37:36.245672 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e48a39f9-cad2-4618-ac03-74aaf5f74165 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 204 len: 0 microversion: 2.1 time: 0.285356 Jun 04 18:37:36.246239 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 372/723] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:37:35 2022] DELETE /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:37:36.254758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-32958750-7820-40c0-a1f0-2a3d35950ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:36.255364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-32958750-7820-40c0-a1f0-2a3d35950ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:36.261435 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32958750-7820-40c0-a1f0-2a3d35950ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:36.261875 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32958750-7820-40c0-a1f0-2a3d35950ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:36.262626 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32958750-7820-40c0-a1f0-2a3d35950ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:36.263054 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32958750-7820-40c0-a1f0-2a3d35950ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:36.404249 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-32958750-7820-40c0-a1f0-2a3d35950ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:36.413041 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-32958750-7820-40c0-a1f0-2a3d35950ade tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1679 microversion: 2.1 time: 0.162274 Jun 04 18:37:36.413607 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 352/724] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:36 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:37:37.435657 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6ebb22dd-42ef-48d7-b6e9-ebec4025d4ee tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:37.436858 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6ebb22dd-42ef-48d7-b6e9-ebec4025d4ee tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:37.449179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6ebb22dd-42ef-48d7-b6e9-ebec4025d4ee tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:37.449932 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6ebb22dd-42ef-48d7-b6e9-ebec4025d4ee tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:37.451198 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6ebb22dd-42ef-48d7-b6e9-ebec4025d4ee tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:37.451921 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6ebb22dd-42ef-48d7-b6e9-ebec4025d4ee tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:37.600513 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6ebb22dd-42ef-48d7-b6e9-ebec4025d4ee tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:37.608394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6ebb22dd-42ef-48d7-b6e9-ebec4025d4ee tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1679 microversion: 2.1 time: 0.179754 Jun 04 18:37:37.608947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 373/725] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:37 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:38.626268 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e1462b3b-47d2-48ba-b8b5-10a02642ea15 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:38.626816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e1462b3b-47d2-48ba-b8b5-10a02642ea15 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:38.634134 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1462b3b-47d2-48ba-b8b5-10a02642ea15 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:38.634581 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1462b3b-47d2-48ba-b8b5-10a02642ea15 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:38.635341 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1462b3b-47d2-48ba-b8b5-10a02642ea15 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:38.635772 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1462b3b-47d2-48ba-b8b5-10a02642ea15 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:38.767065 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e1462b3b-47d2-48ba-b8b5-10a02642ea15 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:38.774699 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e1462b3b-47d2-48ba-b8b5-10a02642ea15 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 200 len: 1679 microversion: 2.1 time: 0.152804 Jun 04 18:37:38.775469 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 353/726] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:38 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:39.122338 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-8086edff-b5c7-49e4-b5cb-bf0cbbc7b6cf req-e415720a-eceb-4a4f-a6a1-992cec6ad70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b570f772-6dc1-446e-9bdb-4368b8e409b4", "name": "network-vif-deleted", "tag": "6bfff902-7d99-4486-bc8e-075cd1d5cd14"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:39.132825 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-8086edff-b5c7-49e4-b5cb-bf0cbbc7b6cf req-e415720a-eceb-4a4f-a6a1-992cec6ad70d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:39.133274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-8086edff-b5c7-49e4-b5cb-bf0cbbc7b6cf req-e415720a-eceb-4a4f-a6a1-992cec6ad70d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:39.145878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-8086edff-b5c7-49e4-b5cb-bf0cbbc7b6cf req-e415720a-eceb-4a4f-a6a1-992cec6ad70d service nova] Creating event network-vif-deleted:6bfff902-7d99-4486-bc8e-075cd1d5cd14 for instance b570f772-6dc1-446e-9bdb-4368b8e409b4 on hv-cinder-79053 Jun 04 18:37:39.151069 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-8086edff-b5c7-49e4-b5cb-bf0cbbc7b6cf req-e415720a-eceb-4a4f-a6a1-992cec6ad70d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Jun 04 18:37:39.151661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 374/727] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:39.792528 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:39.793110 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:39.800451 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:39.800897 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:39.801669 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:39.802098 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:39.816349 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 HTTP/1.1 Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:37:39.818015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:37:39.819523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'b570f772-6dc1-446e-9bdb-4368b8e409b4'} Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:37:39.820454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:37:39.821652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:39.822719 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:37:39.822719 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-00e672c7-1ad1-4147-8c93-9d9d99236aca tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 404 len: 111 microversion: 2.1 time: 0.030853 Jun 04 18:37:39.822719 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 354/728] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:39 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:37:39.829501 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b6c6438d-0e3a-4857-953d-9a0e66488ba3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '.version_select at 0x7f467de03040>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:39.851539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b6c6438d-0e3a-4857-953d-9a0e66488ba3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-808501479" status: 202 len: 0 microversion: 2.1 time: 0.026270 Jun 04 18:37:39.852202 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 375/729] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 4 18:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-808501479 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:37:40.499161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2ee9fbba-8d42-4265-ab7b-30db88d0fadd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: .version_select at 0x7f467e10ec10>, body: {"keypair": {"name": "tempest-keypair-1613977476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBYj6hjJxvGiwi9NXdh/CLuQL/XTV+FM5EhCin+8FbXgQptuMXOgNkd/1yROaU1i8SOizOZ7TZxxqPyB88lFjzSlrhtWjmkX/FZynMAcBNtwGPDsC2mGC5sRKcgPj+PQ=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:40.513530 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-2ee9fbba-8d42-4265-ab7b-30db88d0fadd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:37:40.517470 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-2ee9fbba-8d42-4265-ab7b-30db88d0fadd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for user 5b5a9f5cdfa6494d97617d68880d5552 and project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:37:40.543340 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2ee9fbba-8d42-4265-ab7b-30db88d0fadd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048194 Jun 04 18:37:40.543897 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 355/730] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:37:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:41.906963 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1142719649", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2590cab-faa4-4157-aaba-3c7a446c9e61"}], "security_groups": [{"name": "tempest-securitygroup--1019013011"}], "key_name": "tempest-keypair-1613977476", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:42.022184 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] validate_networks() for [('e2590cab-faa4-4157-aaba-3c7a446c9e61', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:37:42.404065 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:37:42.404493 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:37:42.405119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:37:42.405584 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:37:42.406109 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:37:42.416646 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:42.416758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:42.417469 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:42.417906 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:42.435458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:37:42.439950 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Getting quotas for user 5b5a9f5cdfa6494d97617d68880d5552 and project 71dff5ee406141ec8e0d4a9b58106610. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:37:42.451395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:37:42.453921 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:37:42.502526 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9054d7bc-2799-485a-bcc9-433f0c415c45 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.601719 Jun 04 18:37:42.503078 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 376/731] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:37:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:37:42.514523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7f175724-1d21-42ec-afd1-17f3c4e931eb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:42.515220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7f175724-1d21-42ec-afd1-17f3c4e931eb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:42.570096 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7f175724-1d21-42ec-afd1-17f3c4e931eb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:42.577070 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7f175724-1d21-42ec-afd1-17f3c4e931eb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1242 microversion: 2.1 time: 0.067116 Jun 04 18:37:42.577631 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 356/732] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:42 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:43.594740 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8e93a3e5-5180-44aa-94a4-3fd5a2f7730c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:43.595362 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8e93a3e5-5180-44aa-94a4-3fd5a2f7730c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:43.611354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e93a3e5-5180-44aa-94a4-3fd5a2f7730c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:43.611782 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e93a3e5-5180-44aa-94a4-3fd5a2f7730c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:43.616551 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e93a3e5-5180-44aa-94a4-3fd5a2f7730c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:43.617085 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e93a3e5-5180-44aa-94a4-3fd5a2f7730c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:43.690414 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8e93a3e5-5180-44aa-94a4-3fd5a2f7730c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:43.698383 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8e93a3e5-5180-44aa-94a4-3fd5a2f7730c tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1300 microversion: 2.1 time: 0.108242 Jun 04 18:37:43.698938 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 377/733] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:43 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:44.716135 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9db48a6e-c78f-403d-9b7e-b43dbead46c8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:44.716730 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9db48a6e-c78f-403d-9b7e-b43dbead46c8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:44.724411 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9db48a6e-c78f-403d-9b7e-b43dbead46c8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:44.725210 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9db48a6e-c78f-403d-9b7e-b43dbead46c8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:44.726125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9db48a6e-c78f-403d-9b7e-b43dbead46c8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:44.726631 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9db48a6e-c78f-403d-9b7e-b43dbead46c8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:44.862615 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9db48a6e-c78f-403d-9b7e-b43dbead46c8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:44.870378 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9db48a6e-c78f-403d-9b7e-b43dbead46c8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1368 microversion: 2.1 time: 0.158256 Jun 04 18:37:44.871033 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 357/734] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:44 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:45.208331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-5f7ce593-ef15-42f2-842e-84b69c3f25c9 req-4e31b450-ecf6-455c-8149-6ac1e61ea023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828b8f27-8e5e-423e-9dcc-1e045936637c", "tag": "3a8784e0-838e-4cc7-a4d9-cc19d7dfd5ac"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:45.220623 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-5f7ce593-ef15-42f2-842e-84b69c3f25c9 req-4e31b450-ecf6-455c-8149-6ac1e61ea023 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:45.221257 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-5f7ce593-ef15-42f2-842e-84b69c3f25c9 req-4e31b450-ecf6-455c-8149-6ac1e61ea023 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:45.234907 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-5f7ce593-ef15-42f2-842e-84b69c3f25c9 req-4e31b450-ecf6-455c-8149-6ac1e61ea023 service nova] Creating event network-changed:3a8784e0-838e-4cc7-a4d9-cc19d7dfd5ac for instance 828b8f27-8e5e-423e-9dcc-1e045936637c on hv-cinder-79053 Jun 04 18:37:45.239937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-5f7ce593-ef15-42f2-842e-84b69c3f25c9 req-4e31b450-ecf6-455c-8149-6ac1e61ea023 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035401 Jun 04 18:37:45.240841 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 378/735] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:45.726374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0ab9c6c7-e4c2-4635-9e06-447ccce0e41c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:45.727180 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0ab9c6c7-e4c2-4635-9e06-447ccce0e41c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:45.737858 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ab9c6c7-e4c2-4635-9e06-447ccce0e41c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:45.738466 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ab9c6c7-e4c2-4635-9e06-447ccce0e41c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:45.739562 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ab9c6c7-e4c2-4635-9e06-447ccce0e41c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:45.739970 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ab9c6c7-e4c2-4635-9e06-447ccce0e41c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:45.773065 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0ab9c6c7-e4c2-4635-9e06-447ccce0e41c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:37:45.853344 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0ab9c6c7-e4c2-4635-9e06-447ccce0e41c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 204 len: 0 microversion: 2.1 time: 0.133117 Jun 04 18:37:45.853968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 358/736] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:37:45 2022] DELETE /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:37:45.865896 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4f4da771-beff-4fcf-a69a-f118aa6cb918 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:45.866918 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4f4da771-beff-4fcf-a69a-f118aa6cb918 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:45.876578 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f4da771-beff-4fcf-a69a-f118aa6cb918 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:45.877202 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f4da771-beff-4fcf-a69a-f118aa6cb918 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:45.878478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f4da771-beff-4fcf-a69a-f118aa6cb918 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:45.879021 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f4da771-beff-4fcf-a69a-f118aa6cb918 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:45.888372 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-05f3ea23-67a1-4bed-af0d-b811bdb2a83b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:45.889065 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-05f3ea23-67a1-4bed-af0d-b811bdb2a83b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:45.895469 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05f3ea23-67a1-4bed-af0d-b811bdb2a83b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:45.895890 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05f3ea23-67a1-4bed-af0d-b811bdb2a83b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:45.896682 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05f3ea23-67a1-4bed-af0d-b811bdb2a83b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:45.897112 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05f3ea23-67a1-4bed-af0d-b811bdb2a83b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:46.018613 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4f4da771-beff-4fcf-a69a-f118aa6cb918 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:46.027405 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4f4da771-beff-4fcf-a69a-f118aa6cb918 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1577 microversion: 2.1 time: 0.168082 Jun 04 18:37:46.028305 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 379/737] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:45 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:46.030249 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-05f3ea23-67a1-4bed-af0d-b811bdb2a83b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:46.038432 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-05f3ea23-67a1-4bed-af0d-b811bdb2a83b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1368 microversion: 2.1 time: 0.154209 Jun 04 18:37:46.038955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 359/738] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:45 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:47.050606 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3e6bf5e9-35bf-455a-8793-21f0b57381fd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:47.051758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3e6bf5e9-35bf-455a-8793-21f0b57381fd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:47.054709 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-63f454b7-0fab-4461-ae72-b8e1d144b75d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:47.055430 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-63f454b7-0fab-4461-ae72-b8e1d144b75d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:47.060662 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3e6bf5e9-35bf-455a-8793-21f0b57381fd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:47.061125 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3e6bf5e9-35bf-455a-8793-21f0b57381fd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:47.062055 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3e6bf5e9-35bf-455a-8793-21f0b57381fd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:47.062361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63f454b7-0fab-4461-ae72-b8e1d144b75d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:47.062903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3e6bf5e9-35bf-455a-8793-21f0b57381fd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:47.063022 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63f454b7-0fab-4461-ae72-b8e1d144b75d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:47.063636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63f454b7-0fab-4461-ae72-b8e1d144b75d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:47.064101 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63f454b7-0fab-4461-ae72-b8e1d144b75d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:47.199099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-63f454b7-0fab-4461-ae72-b8e1d144b75d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:47.200989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3e6bf5e9-35bf-455a-8793-21f0b57381fd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:47.206958 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-63f454b7-0fab-4461-ae72-b8e1d144b75d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1368 microversion: 2.1 time: 0.156233 Jun 04 18:37:47.207528 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 360/739] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:47 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:47.208758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3e6bf5e9-35bf-455a-8793-21f0b57381fd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1577 microversion: 2.1 time: 0.165627 Jun 04 18:37:47.209313 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 380/740] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:47 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:48.226227 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d5f597be-1280-4832-a48f-feb72e2c4e73 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:48.226990 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d5f597be-1280-4832-a48f-feb72e2c4e73 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:48.227420 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-634d6b34-eeaa-4efc-a639-54080a7d11c4 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:48.228297 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-634d6b34-eeaa-4efc-a639-54080a7d11c4 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:48.236524 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d5f597be-1280-4832-a48f-feb72e2c4e73 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:48.237148 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d5f597be-1280-4832-a48f-feb72e2c4e73 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:48.237390 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-634d6b34-eeaa-4efc-a639-54080a7d11c4 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:48.237798 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-634d6b34-eeaa-4efc-a639-54080a7d11c4 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:48.238160 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d5f597be-1280-4832-a48f-feb72e2c4e73 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:48.238734 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d5f597be-1280-4832-a48f-feb72e2c4e73 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:48.238924 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-634d6b34-eeaa-4efc-a639-54080a7d11c4 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:48.239382 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-634d6b34-eeaa-4efc-a639-54080a7d11c4 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:48.374784 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-634d6b34-eeaa-4efc-a639-54080a7d11c4 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:48.378872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d5f597be-1280-4832-a48f-feb72e2c4e73 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:48.382992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-634d6b34-eeaa-4efc-a639-54080a7d11c4 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1577 microversion: 2.1 time: 0.160731 Jun 04 18:37:48.383666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 381/741] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:48 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:48.386255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d5f597be-1280-4832-a48f-feb72e2c4e73 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1368 microversion: 2.1 time: 0.165497 Jun 04 18:37:48.386801 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 361/742] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:48 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:49.401356 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-88304054-b62e-4abe-bee6-dcd7dfa20e0d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:49.402064 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-88304054-b62e-4abe-bee6-dcd7dfa20e0d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:49.402728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d8d8cc27-7d90-4ad6-9356-800d5da8ae08 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:49.403346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d8d8cc27-7d90-4ad6-9356-800d5da8ae08 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:49.411134 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8d8cc27-7d90-4ad6-9356-800d5da8ae08 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:49.411330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88304054-b62e-4abe-bee6-dcd7dfa20e0d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:49.411577 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8d8cc27-7d90-4ad6-9356-800d5da8ae08 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:49.411743 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88304054-b62e-4abe-bee6-dcd7dfa20e0d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:49.412421 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8d8cc27-7d90-4ad6-9356-800d5da8ae08 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:49.412557 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88304054-b62e-4abe-bee6-dcd7dfa20e0d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:49.412856 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8d8cc27-7d90-4ad6-9356-800d5da8ae08 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:49.412993 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88304054-b62e-4abe-bee6-dcd7dfa20e0d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:49.546533 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d8d8cc27-7d90-4ad6-9356-800d5da8ae08 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:49.554577 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d8d8cc27-7d90-4ad6-9356-800d5da8ae08 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1368 microversion: 2.1 time: 0.155663 Jun 04 18:37:49.555156 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 362/743] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:49 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:49.559851 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b6bb3bf2-0ad6-417b-a3a8-aa89d222b07b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:49.560371 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b6bb3bf2-0ad6-417b-a3a8-aa89d222b07b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:49.566736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6bb3bf2-0ad6-417b-a3a8-aa89d222b07b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:49.567188 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6bb3bf2-0ad6-417b-a3a8-aa89d222b07b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:49.567960 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6bb3bf2-0ad6-417b-a3a8-aa89d222b07b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:49.568424 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6bb3bf2-0ad6-417b-a3a8-aa89d222b07b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:49.577065 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-88304054-b62e-4abe-bee6-dcd7dfa20e0d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:49.584816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-88304054-b62e-4abe-bee6-dcd7dfa20e0d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1577 microversion: 2.1 time: 0.187512 Jun 04 18:37:49.585382 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 382/744] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:49 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:49.592495 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b6bb3bf2-0ad6-417b-a3a8-aa89d222b07b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/ips" status: 200 len: 146 microversion: 2.1 time: 0.036279 Jun 04 18:37:49.593059 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 363/745] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:37:49 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:50.571514 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-28dedcfa-7bb6-4149-8833-dd5d9eedadc2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:50.572394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-28dedcfa-7bb6-4149-8833-dd5d9eedadc2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:50.583148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28dedcfa-7bb6-4149-8833-dd5d9eedadc2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:50.584133 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28dedcfa-7bb6-4149-8833-dd5d9eedadc2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:50.585614 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28dedcfa-7bb6-4149-8833-dd5d9eedadc2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:50.586267 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-28dedcfa-7bb6-4149-8833-dd5d9eedadc2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:50.601941 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4343b6de-5f92-44ba-a189-d121deea97e3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:50.603195 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4343b6de-5f92-44ba-a189-d121deea97e3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:50.612074 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4343b6de-5f92-44ba-a189-d121deea97e3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:50.613371 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4343b6de-5f92-44ba-a189-d121deea97e3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:50.614798 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4343b6de-5f92-44ba-a189-d121deea97e3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:50.615588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4343b6de-5f92-44ba-a189-d121deea97e3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:50.722648 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4343b6de-5f92-44ba-a189-d121deea97e3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:50.726696 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:50.733549 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4343b6de-5f92-44ba-a189-d121deea97e3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 200 len: 1509 microversion: 2.1 time: 0.135592 Jun 04 18:37:50.743822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 364/746] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:50 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:37:50.752310 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-ad72638e-1443-4f14-9a65-8b278fb0fab5 req-6cb4c336-c96a-4c7e-847f-16df0c724175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19a4a77-7305-41d2-913c-d40b18d5d926", "name": "network-vif-deleted", "tag": "579c9e95-870c-43c9-9e8c-5736b6552a27"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:50.764351 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ad72638e-1443-4f14-9a65-8b278fb0fab5 req-6cb4c336-c96a-4c7e-847f-16df0c724175 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:50.765063 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ad72638e-1443-4f14-9a65-8b278fb0fab5 req-6cb4c336-c96a-4c7e-847f-16df0c724175 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:50.785968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-ad72638e-1443-4f14-9a65-8b278fb0fab5 req-6cb4c336-c96a-4c7e-847f-16df0c724175 service nova] Creating event network-vif-deleted:579c9e95-870c-43c9-9e8c-5736b6552a27 for instance e19a4a77-7305-41d2-913c-d40b18d5d926 on hv-cinder-79053 Jun 04 18:37:50.791671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-ad72638e-1443-4f14-9a65-8b278fb0fab5 req-6cb4c336-c96a-4c7e-847f-16df0c724175 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046157 Jun 04 18:37:50.792563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 365/747] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:50.800627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-bf0a8acf-2613-496b-a58b-c89a3985be46 req-f560e9cd-3e04-4c43-b6e3-c5cff5f9963a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828b8f27-8e5e-423e-9dcc-1e045936637c", "name": "network-vif-plugged", "status": "completed", "tag": "3a8784e0-838e-4cc7-a4d9-cc19d7dfd5ac"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:50.814856 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-28dedcfa-7bb6-4149-8833-dd5d9eedadc2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:50.820766 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-bf0a8acf-2613-496b-a58b-c89a3985be46 req-f560e9cd-3e04-4c43-b6e3-c5cff5f9963a service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:50.821800 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-bf0a8acf-2613-496b-a58b-c89a3985be46 req-f560e9cd-3e04-4c43-b6e3-c5cff5f9963a service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:50.822627 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-28dedcfa-7bb6-4149-8833-dd5d9eedadc2 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1368 microversion: 2.1 time: 0.255270 Jun 04 18:37:50.833442 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 383/748] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:50 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:50.838574 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-bf0a8acf-2613-496b-a58b-c89a3985be46 req-f560e9cd-3e04-4c43-b6e3-c5cff5f9963a service nova] Creating event network-vif-plugged:3a8784e0-838e-4cc7-a4d9-cc19d7dfd5ac for instance 828b8f27-8e5e-423e-9dcc-1e045936637c on hv-cinder-79053 Jun 04 18:37:50.843816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-bf0a8acf-2613-496b-a58b-c89a3985be46 req-f560e9cd-3e04-4c43-b6e3-c5cff5f9963a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049645 Jun 04 18:37:50.845157 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 366/749] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:50.948378 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cccf2bb4-ed2c-4b0c-b787-45dc40c438c3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc2cee63-9f67-4cd5-8b98-248f07492e15"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:50.949390 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cccf2bb4-ed2c-4b0c-b787-45dc40c438c3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:50.963979 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cccf2bb4-ed2c-4b0c-b787-45dc40c438c3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:50.964464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cccf2bb4-ed2c-4b0c-b787-45dc40c438c3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:50.965251 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cccf2bb4-ed2c-4b0c-b787-45dc40c438c3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:50.965687 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cccf2bb4-ed2c-4b0c-b787-45dc40c438c3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:51.452784 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cccf2bb4-ed2c-4b0c-b787-45dc40c438c3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508900 Jun 04 18:37:51.453546 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 384/750] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:37:50 2022] POST /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:37:51.751355 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:51.752275 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:51.758948 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:51.759967 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:51.762083 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:51.762566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:51.778674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] HTTP exception thrown: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Request method failure captured: Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 HTTP/1.1 Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6WxdfSUl0tipBd3mtfxBqzOQ7RaxEa1Kt3hnaIVE-cssElfw3iwz56KTq3Fp-PxoMoEvY9i5mTlerhn4BmF6kl2IPjyDgwXCKduFwAvVMWbkHtYD_bUoREJY32lwaPezxWNU5MCmrlqAQ1RSEzuDCSmwujTol_xEQ6K8l5YUc0hXUw Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:37:51.780764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}] Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: cf94c76ba04b403b91a7ff77a2f476e8 Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:37:51.783343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'e19a4a77-7305-41d2-913c-d40b18d5d926'} Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:37:51.784613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:37:51.786464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:37:51.788335 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Returning 404 to user: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:37:51.788335 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-323f48c3-7dd3-4e9d-8e93-78dc18a22976 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 404 len: 111 microversion: 2.1 time: 0.036009 Jun 04 18:37:51.788335 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 367/751] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:51 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:37:51.844392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-769462f3-7d05-401a-ab84-3abef6cf77a8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:51.846246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-769462f3-7d05-401a-ab84-3abef6cf77a8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:51.852638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-769462f3-7d05-401a-ab84-3abef6cf77a8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:51.853163 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-769462f3-7d05-401a-ab84-3abef6cf77a8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:51.854059 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-769462f3-7d05-401a-ab84-3abef6cf77a8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:51.854629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-769462f3-7d05-401a-ab84-3abef6cf77a8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:51.886625 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1410353238", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-493393868", "security_groups": [{"name": "tempest-secgroup-smoke-1787165407"}], "block_device_mapping_v2": [{"uuid": "76297bf4-cceb-46ae-bcbd-2c80c798884e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9fe7d892-020a-4605-a021-7aea70be8ad6"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:51.996074 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-769462f3-7d05-401a-ab84-3abef6cf77a8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:51.999849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:52.004820 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] validate_networks() for [('9fe7d892-020a-4605-a021-7aea70be8ad6', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:37:52.005611 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-769462f3-7d05-401a-ab84-3abef6cf77a8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1368 microversion: 2.1 time: 0.168818 Jun 04 18:37:52.006178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 385/752] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:51 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:52.386648 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:37:52.387072 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:37:52.387545 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:37:52.387950 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:37:52.388394 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:37:52.398493 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:52.398935 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:52.399726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:52.400193 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:52.417738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Getting quotas for project 2829dcddd2864698b273038b8df5ce76. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:37:52.421757 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Getting quotas for user cf94c76ba04b403b91a7ff77a2f476e8 and project 2829dcddd2864698b273038b8df5ce76. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:37:52.481565 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:37:52.483704 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76297bf4-cceb-46ae-bcbd-2c80c798884e',volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:37:52.621876 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c9b202c2-497a-48b9-83e7-cbac11173d32 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.739267 Jun 04 18:37:52.622624 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 368/753] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:37:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 18:37:52.633168 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-345fc8a0-8291-4951-a56c-afdd25842775 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:52.634111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-345fc8a0-8291-4951-a56c-afdd25842775 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:52.638356 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:52.639106 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:52.692739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-345fc8a0-8291-4951-a56c-afdd25842775 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:52.700184 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-345fc8a0-8291-4951-a56c-afdd25842775 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1094 microversion: 2.1 time: 0.070300 Jun 04 18:37:52.700184 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 386/754] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:52 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:53.023703 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6277f6ff-cc6b-4a58-830f-820c97a9d902 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:53.024447 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6277f6ff-cc6b-4a58-830f-820c97a9d902 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:53.033181 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6277f6ff-cc6b-4a58-830f-820c97a9d902 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:53.033788 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6277f6ff-cc6b-4a58-830f-820c97a9d902 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:53.034647 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6277f6ff-cc6b-4a58-830f-820c97a9d902 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:53.035153 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6277f6ff-cc6b-4a58-830f-820c97a9d902 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:53.422679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6277f6ff-cc6b-4a58-830f-820c97a9d902 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:53.430556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6277f6ff-cc6b-4a58-830f-820c97a9d902 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1368 microversion: 2.1 time: 0.411518 Jun 04 18:37:53.431047 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 369/755] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:53 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1368 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:53.716037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-da53c7f3-84d9-46c6-a373-642f90d9a9dd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:53.716767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-da53c7f3-84d9-46c6-a373-642f90d9a9dd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:53.725112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da53c7f3-84d9-46c6-a373-642f90d9a9dd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:53.725563 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da53c7f3-84d9-46c6-a373-642f90d9a9dd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:53.726337 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da53c7f3-84d9-46c6-a373-642f90d9a9dd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:53.726770 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da53c7f3-84d9-46c6-a373-642f90d9a9dd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:53.794926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-da53c7f3-84d9-46c6-a373-642f90d9a9dd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:53.802965 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-da53c7f3-84d9-46c6-a373-642f90d9a9dd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1210 microversion: 2.1 time: 0.091012 Jun 04 18:37:53.803647 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 387/756] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:53 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:54.452266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-acfb6e91-e986-4db0-b893-036a3adf7050 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:54.454566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-acfb6e91-e986-4db0-b893-036a3adf7050 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:54.464152 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acfb6e91-e986-4db0-b893-036a3adf7050 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:54.464743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acfb6e91-e986-4db0-b893-036a3adf7050 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:54.465639 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acfb6e91-e986-4db0-b893-036a3adf7050 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:54.466094 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-acfb6e91-e986-4db0-b893-036a3adf7050 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:54.741991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-acfb6e91-e986-4db0-b893-036a3adf7050 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:54.749959 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-acfb6e91-e986-4db0-b893-036a3adf7050 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1558 microversion: 2.1 time: 0.302413 Jun 04 18:37:54.751238 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 370/757] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:54 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1558 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:54.769367 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ade14f49-327b-4eaf-b968-6db47d2de6b8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:54.770485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ade14f49-327b-4eaf-b968-6db47d2de6b8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:54.777429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ade14f49-327b-4eaf-b968-6db47d2de6b8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:54.778106 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ade14f49-327b-4eaf-b968-6db47d2de6b8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:54.778994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ade14f49-327b-4eaf-b968-6db47d2de6b8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:54.779441 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ade14f49-327b-4eaf-b968-6db47d2de6b8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:54.820286 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-21e5a69c-bb91-4b34-8c3c-72957593f024 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:54.820976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-21e5a69c-bb91-4b34-8c3c-72957593f024 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:54.827264 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21e5a69c-bb91-4b34-8c3c-72957593f024 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:54.827640 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21e5a69c-bb91-4b34-8c3c-72957593f024 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:54.828449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21e5a69c-bb91-4b34-8c3c-72957593f024 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:54.829124 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21e5a69c-bb91-4b34-8c3c-72957593f024 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:54.866087 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ade14f49-327b-4eaf-b968-6db47d2de6b8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102022 Jun 04 18:37:54.866673 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 388/758] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 4 18:37:54 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:55.065872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-21e5a69c-bb91-4b34-8c3c-72957593f024 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:55.074412 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-21e5a69c-bb91-4b34-8c3c-72957593f024 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1278 microversion: 2.1 time: 0.257960 Jun 04 18:37:55.084462 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 371/759] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:54 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:37:55.227278 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-83bfe4bf-9d9f-4edf-91e1-bc1ff71dc7aa req-58ae0e55-358a-4fd0-af37-d2723c7d480b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf23d455-c4ee-41bb-b074-7a2e399fd8c0", "tag": "9892af68-c3a6-4862-855b-ea6a4e9a33c2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:55.236575 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:55.242068 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-83bfe4bf-9d9f-4edf-91e1-bc1ff71dc7aa req-58ae0e55-358a-4fd0-af37-d2723c7d480b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:55.242771 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-83bfe4bf-9d9f-4edf-91e1-bc1ff71dc7aa req-58ae0e55-358a-4fd0-af37-d2723c7d480b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:55.261381 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-83bfe4bf-9d9f-4edf-91e1-bc1ff71dc7aa req-58ae0e55-358a-4fd0-af37-d2723c7d480b service nova] Creating event network-changed:9892af68-c3a6-4862-855b-ea6a4e9a33c2 for instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 on hv-cinder-79053 Jun 04 18:37:55.269285 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-83bfe4bf-9d9f-4edf-91e1-bc1ff71dc7aa req-58ae0e55-358a-4fd0-af37-d2723c7d480b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045557 Jun 04 18:37:55.270084 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 389/760] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:55.875755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-d1fccf4a-31ec-4928-aa93-429c817bfc36 req-bd9fe728-c9ac-47a0-9e60-b25c7069e7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828b8f27-8e5e-423e-9dcc-1e045936637c", "tag": "3a8784e0-838e-4cc7-a4d9-cc19d7dfd5ac"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:37:55.885017 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d1fccf4a-31ec-4928-aa93-429c817bfc36 req-bd9fe728-c9ac-47a0-9e60-b25c7069e7c5 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:55.885460 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d1fccf4a-31ec-4928-aa93-429c817bfc36 req-bd9fe728-c9ac-47a0-9e60-b25c7069e7c5 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:55.897927 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-d1fccf4a-31ec-4928-aa93-429c817bfc36 req-bd9fe728-c9ac-47a0-9e60-b25c7069e7c5 service nova] Creating event network-changed:3a8784e0-838e-4cc7-a4d9-cc19d7dfd5ac for instance 828b8f27-8e5e-423e-9dcc-1e045936637c on hv-cinder-79053 Jun 04 18:37:55.903299 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-d1fccf4a-31ec-4928-aa93-429c817bfc36 req-bd9fe728-c9ac-47a0-9e60-b25c7069e7c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031265 Jun 04 18:37:55.904111 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 372/761] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:37:56.091873 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-58b3d221-04bf-4e08-b18b-f517017ef274 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:56.093245 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-58b3d221-04bf-4e08-b18b-f517017ef274 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:56.100696 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58b3d221-04bf-4e08-b18b-f517017ef274 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:56.101407 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58b3d221-04bf-4e08-b18b-f517017ef274 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:56.102362 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58b3d221-04bf-4e08-b18b-f517017ef274 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:56.102977 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58b3d221-04bf-4e08-b18b-f517017ef274 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:56.306104 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-58b3d221-04bf-4e08-b18b-f517017ef274 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:56.317429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-58b3d221-04bf-4e08-b18b-f517017ef274 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1278 microversion: 2.1 time: 0.230205 Jun 04 18:37:56.318263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 390/762] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:56 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:57.335200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e358012f-a080-4afb-b424-1e384ec1ee6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:57.335887 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e358012f-a080-4afb-b424-1e384ec1ee6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:57.338345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:57.344569 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e358012f-a080-4afb-b424-1e384ec1ee6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:57.345052 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e358012f-a080-4afb-b424-1e384ec1ee6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:57.345849 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e358012f-a080-4afb-b424-1e384ec1ee6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:57.346309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e358012f-a080-4afb-b424-1e384ec1ee6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:57.481303 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e358012f-a080-4afb-b424-1e384ec1ee6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:57.489162 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e358012f-a080-4afb-b424-1e384ec1ee6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1278 microversion: 2.1 time: 0.158294 Jun 04 18:37:57.489760 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 373/763] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:57 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:58.508597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8f8d328a-6f24-47e1-8427-25bafcf7a008 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:58.509383 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8f8d328a-6f24-47e1-8427-25bafcf7a008 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:58.518881 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8f8d328a-6f24-47e1-8427-25bafcf7a008 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:58.519334 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8f8d328a-6f24-47e1-8427-25bafcf7a008 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:58.520128 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8f8d328a-6f24-47e1-8427-25bafcf7a008 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:58.520558 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8f8d328a-6f24-47e1-8427-25bafcf7a008 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:58.677236 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8f8d328a-6f24-47e1-8427-25bafcf7a008 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:58.684993 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8f8d328a-6f24-47e1-8427-25bafcf7a008 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1278 microversion: 2.1 time: 0.182119 Jun 04 18:37:58.685552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 391/764] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:58 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:37:58.990206 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-eaaf3504-54dd-4d2b-8e48-32ee25e133e7 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:58.991136 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-eaaf3504-54dd-4d2b-8e48-32ee25e133e7 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:58.997932 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaaf3504-54dd-4d2b-8e48-32ee25e133e7 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:58.998379 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaaf3504-54dd-4d2b-8e48-32ee25e133e7 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:58.999136 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaaf3504-54dd-4d2b-8e48-32ee25e133e7 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:58.999601 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaaf3504-54dd-4d2b-8e48-32ee25e133e7 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:59.030311 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-eaaf3504-54dd-4d2b-8e48-32ee25e133e7 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Jun 04 18:37:59.030858 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 374/765] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:37:58 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:59.041377 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4fcbbfa8-dac3-4a96-8651-6452295e5bf8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:59.041878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4fcbbfa8-dac3-4a96-8651-6452295e5bf8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:59.048302 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fcbbfa8-dac3-4a96-8651-6452295e5bf8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:59.048759 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fcbbfa8-dac3-4a96-8651-6452295e5bf8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:59.049531 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fcbbfa8-dac3-4a96-8651-6452295e5bf8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:59.049972 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fcbbfa8-dac3-4a96-8651-6452295e5bf8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:59.078431 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4fcbbfa8-dac3-4a96-8651-6452295e5bf8 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/dc2cee63-9f67-4cd5-8b98-248f07492e15" status: 200 len: 194 microversion: 2.1 time: 0.040984 Jun 04 18:37:59.078989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 392/766] 10.222.0.39 () {58 vars in 1412 bytes} [Sat Jun 4 18:37:59 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/dc2cee63-9f67-4cd5-8b98-248f07492e15 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:37:59.704903 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cf881adb-e26e-4828-bec0-8dabb11a465d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:37:59.705841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cf881adb-e26e-4828-bec0-8dabb11a465d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:37:59.715770 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cf881adb-e26e-4828-bec0-8dabb11a465d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:59.716523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cf881adb-e26e-4828-bec0-8dabb11a465d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:59.717724 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cf881adb-e26e-4828-bec0-8dabb11a465d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:37:59.718374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cf881adb-e26e-4828-bec0-8dabb11a465d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:37:59.870048 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cf881adb-e26e-4828-bec0-8dabb11a465d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:37:59.878043 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cf881adb-e26e-4828-bec0-8dabb11a465d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.178759 Jun 04 18:37:59.878614 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 375/767] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:37:59 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:00.400366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e18770ae-48f4-4596-82b3-f3856533592f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3119154-0d76-4f2a-a455-cc6cf2742dc4"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:38:00.401493 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e18770ae-48f4-4596-82b3-f3856533592f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:00.408882 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e18770ae-48f4-4596-82b3-f3856533592f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:00.409327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e18770ae-48f4-4596-82b3-f3856533592f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:00.410098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e18770ae-48f4-4596-82b3-f3856533592f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:00.410537 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e18770ae-48f4-4596-82b3-f3856533592f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:00.662180 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e18770ae-48f4-4596-82b3-f3856533592f tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "POST /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265553 Jun 04 18:38:00.662805 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 393/768] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:38:00 2022] POST /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:38:00.895312 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6a2f7a0f-d611-4863-afe7-6d6badee1f68 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:00.895915 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6a2f7a0f-d611-4863-afe7-6d6badee1f68 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:00.903158 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6a2f7a0f-d611-4863-afe7-6d6badee1f68 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:00.903603 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6a2f7a0f-d611-4863-afe7-6d6badee1f68 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:00.904398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6a2f7a0f-d611-4863-afe7-6d6badee1f68 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:00.904823 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6a2f7a0f-d611-4863-afe7-6d6badee1f68 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:01.043265 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6a2f7a0f-d611-4863-afe7-6d6badee1f68 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:01.052436 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6a2f7a0f-d611-4863-afe7-6d6badee1f68 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.160992 Jun 04 18:38:01.053351 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 376/769] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:00 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:02.074522 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d275308-5ae9-4529-9150-4b588b82287f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:02.075109 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7d275308-5ae9-4529-9150-4b588b82287f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:02.082145 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d275308-5ae9-4529-9150-4b588b82287f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:02.082625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d275308-5ae9-4529-9150-4b588b82287f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:02.083435 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d275308-5ae9-4529-9150-4b588b82287f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:02.083899 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d275308-5ae9-4529-9150-4b588b82287f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:02.221064 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d275308-5ae9-4529-9150-4b588b82287f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:02.228880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7d275308-5ae9-4529-9150-4b588b82287f tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.160604 Jun 04 18:38:02.229442 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 394/770] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:02 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:03.245815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fb7bcfd9-69a4-4512-82e7-0634e4cb7cb9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:03.246450 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fb7bcfd9-69a4-4512-82e7-0634e4cb7cb9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:03.248872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:03.249517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=12 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:03.255276 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb7bcfd9-69a4-4512-82e7-0634e4cb7cb9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:03.255725 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb7bcfd9-69a4-4512-82e7-0634e4cb7cb9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:03.256509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb7bcfd9-69a4-4512-82e7-0634e4cb7cb9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:03.257064 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb7bcfd9-69a4-4512-82e7-0634e4cb7cb9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:03.390939 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fb7bcfd9-69a4-4512-82e7-0634e4cb7cb9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:03.402526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fb7bcfd9-69a4-4512-82e7-0634e4cb7cb9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.160384 Jun 04 18:38:03.403295 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 377/771] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:03 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:04.427412 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-14df8964-d977-4ad3-a7b5-902bfe3ddead tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:04.428510 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-14df8964-d977-4ad3-a7b5-902bfe3ddead tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:04.433070 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:04.442424 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14df8964-d977-4ad3-a7b5-902bfe3ddead tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:04.443156 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14df8964-d977-4ad3-a7b5-902bfe3ddead tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:04.444727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14df8964-d977-4ad3-a7b5-902bfe3ddead tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:04.445489 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14df8964-d977-4ad3-a7b5-902bfe3ddead tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:04.580710 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-14df8964-d977-4ad3-a7b5-902bfe3ddead tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:04.589684 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-14df8964-d977-4ad3-a7b5-902bfe3ddead tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.168982 Jun 04 18:38:04.590255 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 395/772] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:04 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:05.611251 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8123ab94-2e46-4fd4-a7f0-233f605f662d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:05.612129 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8123ab94-2e46-4fd4-a7f0-233f605f662d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:05.621018 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8123ab94-2e46-4fd4-a7f0-233f605f662d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:05.621465 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8123ab94-2e46-4fd4-a7f0-233f605f662d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:05.622226 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8123ab94-2e46-4fd4-a7f0-233f605f662d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:05.622658 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8123ab94-2e46-4fd4-a7f0-233f605f662d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:05.760117 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8123ab94-2e46-4fd4-a7f0-233f605f662d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:05.771682 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8123ab94-2e46-4fd4-a7f0-233f605f662d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.166766 Jun 04 18:38:05.772540 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 378/773] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:05 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:06.794200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-67b5eb09-d56e-421d-9426-38b5c1cba481 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:06.794893 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-67b5eb09-d56e-421d-9426-38b5c1cba481 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:06.801836 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-67b5eb09-d56e-421d-9426-38b5c1cba481 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:06.802358 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-67b5eb09-d56e-421d-9426-38b5c1cba481 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:06.803191 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-67b5eb09-d56e-421d-9426-38b5c1cba481 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:06.804095 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-67b5eb09-d56e-421d-9426-38b5c1cba481 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:06.937608 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-67b5eb09-d56e-421d-9426-38b5c1cba481 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:06.945393 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-67b5eb09-d56e-421d-9426-38b5c1cba481 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.155165 Jun 04 18:38:06.945966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 396/774] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:06 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:07.966174 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2b98e3dd-43a6-462b-a153-fb407eb87dfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:07.967371 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2b98e3dd-43a6-462b-a153-fb407eb87dfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:07.978148 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b98e3dd-43a6-462b-a153-fb407eb87dfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:07.978581 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b98e3dd-43a6-462b-a153-fb407eb87dfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:07.979349 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b98e3dd-43a6-462b-a153-fb407eb87dfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:07.979786 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b98e3dd-43a6-462b-a153-fb407eb87dfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:08.112825 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2b98e3dd-43a6-462b-a153-fb407eb87dfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:08.122466 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2b98e3dd-43a6-462b-a153-fb407eb87dfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.163057 Jun 04 18:38:08.123042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 379/775] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:07 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:08.191808 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9b8409d9-f11d-4a3c-9198-301eb37890c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:08.192808 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9b8409d9-f11d-4a3c-9198-301eb37890c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:08.199926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b8409d9-f11d-4a3c-9198-301eb37890c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:08.200416 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b8409d9-f11d-4a3c-9198-301eb37890c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:08.201194 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b8409d9-f11d-4a3c-9198-301eb37890c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:08.201635 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b8409d9-f11d-4a3c-9198-301eb37890c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:08.232518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9b8409d9-f11d-4a3c-9198-301eb37890c1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044610 Jun 04 18:38:08.233294 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 397/776] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:38:08 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:38:08.376867 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-25a10e75-164d-4021-9780-967801ab1ecd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:08.377362 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-25a10e75-164d-4021-9780-967801ab1ecd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:08.383488 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25a10e75-164d-4021-9780-967801ab1ecd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:08.383941 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25a10e75-164d-4021-9780-967801ab1ecd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:08.384767 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25a10e75-164d-4021-9780-967801ab1ecd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:08.385203 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25a10e75-164d-4021-9780-967801ab1ecd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:08.415916 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-25a10e75-164d-4021-9780-967801ab1ecd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/dc2cee63-9f67-4cd5-8b98-248f07492e15" status: 200 len: 194 microversion: 2.1 time: 0.043106 Jun 04 18:38:08.416568 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 380/777] 10.222.0.39 () {58 vars in 1412 bytes} [Sat Jun 4 18:38:08 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/dc2cee63-9f67-4cd5-8b98-248f07492e15 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:38:08.429693 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4876ee2c-b6b8-481a-ac8d-65a2ed97d89b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:08.430688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4876ee2c-b6b8-481a-ac8d-65a2ed97d89b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:08.437119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4876ee2c-b6b8-481a-ac8d-65a2ed97d89b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:08.437565 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4876ee2c-b6b8-481a-ac8d-65a2ed97d89b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:08.438328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4876ee2c-b6b8-481a-ac8d-65a2ed97d89b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:08.438761 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4876ee2c-b6b8-481a-ac8d-65a2ed97d89b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:08.538104 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-4876ee2c-b6b8-481a-ac8d-65a2ed97d89b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lazy-loading 'services' on Instance uuid d5e757cd-3a43-458f-b9da-341ebfcc1bae {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:38:08.620107 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4876ee2c-b6b8-481a-ac8d-65a2ed97d89b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/dc2cee63-9f67-4cd5-8b98-248f07492e15" status: 202 len: 0 microversion: 2.1 time: 0.196768 Jun 04 18:38:08.620696 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 398/778] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:38:08 2022] DELETE /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/dc2cee63-9f67-4cd5-8b98-248f07492e15 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:38:08.741819 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-d3fd33f0-33ab-4704-9021-8bcbdd503871 req-8de14902-e249-4d63-bc9f-5b3458f1f82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf23d455-c4ee-41bb-b074-7a2e399fd8c0", "name": "network-vif-plugged", "status": "completed", "tag": "9892af68-c3a6-4862-855b-ea6a4e9a33c2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:38:08.750289 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d3fd33f0-33ab-4704-9021-8bcbdd503871 req-8de14902-e249-4d63-bc9f-5b3458f1f82d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:08.750709 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d3fd33f0-33ab-4704-9021-8bcbdd503871 req-8de14902-e249-4d63-bc9f-5b3458f1f82d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:08.762306 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-d3fd33f0-33ab-4704-9021-8bcbdd503871 req-8de14902-e249-4d63-bc9f-5b3458f1f82d service nova] Creating event network-vif-plugged:9892af68-c3a6-4862-855b-ea6a4e9a33c2 for instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 on hv-cinder-79053 Jun 04 18:38:08.767354 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-d3fd33f0-33ab-4704-9021-8bcbdd503871 req-8de14902-e249-4d63-bc9f-5b3458f1f82d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029309 Jun 04 18:38:08.767939 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 381/779] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:38:09.144210 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c548994d-8acf-41ce-9290-ea2e57098834 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:09.145391 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c548994d-8acf-41ce-9290-ea2e57098834 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:09.155381 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c548994d-8acf-41ce-9290-ea2e57098834 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:09.155939 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c548994d-8acf-41ce-9290-ea2e57098834 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:09.156795 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c548994d-8acf-41ce-9290-ea2e57098834 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:09.157216 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c548994d-8acf-41ce-9290-ea2e57098834 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:09.167618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-043b3ee4-815f-434e-8017-9bb6173f5740 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:09.168326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-043b3ee4-815f-434e-8017-9bb6173f5740 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:09.174604 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-043b3ee4-815f-434e-8017-9bb6173f5740 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:09.175056 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-043b3ee4-815f-434e-8017-9bb6173f5740 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:09.175829 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-043b3ee4-815f-434e-8017-9bb6173f5740 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:09.176671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-043b3ee4-815f-434e-8017-9bb6173f5740 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:09.200517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-043b3ee4-815f-434e-8017-9bb6173f5740 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/ips" status: 200 len: 151 microversion: 2.20 time: 0.038019 Jun 04 18:38:09.201099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 382/780] 10.222.0.39 () {60 vars in 1288 bytes} [Sat Jun 4 18:38:09 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 18:38:09.296921 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c548994d-8acf-41ce-9290-ea2e57098834 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:09.304578 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c548994d-8acf-41ce-9290-ea2e57098834 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.167083 Jun 04 18:38:09.306205 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 399/781] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:09 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:10.324272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9a597e40-d575-42d8-a7b3-da47984f8ee6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:10.324884 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9a597e40-d575-42d8-a7b3-da47984f8ee6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:10.331741 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9a597e40-d575-42d8-a7b3-da47984f8ee6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:10.332224 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9a597e40-d575-42d8-a7b3-da47984f8ee6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:10.332981 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9a597e40-d575-42d8-a7b3-da47984f8ee6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:10.333412 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9a597e40-d575-42d8-a7b3-da47984f8ee6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:10.487811 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9a597e40-d575-42d8-a7b3-da47984f8ee6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:10.496036 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9a597e40-d575-42d8-a7b3-da47984f8ee6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1266 microversion: 2.1 time: 0.176523 Jun 04 18:38:10.496627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 383/782] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:10 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:10.817526 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a316a341-4c77-4dd5-9c29-adfecdd2c0fd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:10.818039 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a316a341-4c77-4dd5-9c29-adfecdd2c0fd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:10.825341 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a316a341-4c77-4dd5-9c29-adfecdd2c0fd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:10.825793 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a316a341-4c77-4dd5-9c29-adfecdd2c0fd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:10.826558 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a316a341-4c77-4dd5-9c29-adfecdd2c0fd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:10.826992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a316a341-4c77-4dd5-9c29-adfecdd2c0fd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:10.857309 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a316a341-4c77-4dd5-9c29-adfecdd2c0fd tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/e3119154-0d76-4f2a-a455-cc6cf2742dc4" status: 200 len: 194 microversion: 2.1 time: 0.043819 Jun 04 18:38:10.857903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 400/783] 10.222.0.39 () {58 vars in 1412 bytes} [Sat Jun 4 18:38:10 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/e3119154-0d76-4f2a-a455-cc6cf2742dc4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:38:10.870374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-20e1fb53-4ab6-4b7f-a522-e8bb59e1a053 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:10.871154 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-20e1fb53-4ab6-4b7f-a522-e8bb59e1a053 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:10.881022 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-20e1fb53-4ab6-4b7f-a522-e8bb59e1a053 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:10.881353 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-20e1fb53-4ab6-4b7f-a522-e8bb59e1a053 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:10.882573 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-20e1fb53-4ab6-4b7f-a522-e8bb59e1a053 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:10.883214 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-20e1fb53-4ab6-4b7f-a522-e8bb59e1a053 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:10.966498 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-20e1fb53-4ab6-4b7f-a522-e8bb59e1a053 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lazy-loading 'services' on Instance uuid d5e757cd-3a43-458f-b9da-341ebfcc1bae {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:38:11.043604 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-20e1fb53-4ab6-4b7f-a522-e8bb59e1a053 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/e3119154-0d76-4f2a-a455-cc6cf2742dc4" status: 202 len: 0 microversion: 2.1 time: 0.179274 Jun 04 18:38:11.044222 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 384/784] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:38:10 2022] DELETE /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments/e3119154-0d76-4f2a-a455-cc6cf2742dc4 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:38:11.243405 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1de42543-26a9-4cac-9514-c442f8409fab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:38:11.243943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1de42543-26a9-4cac-9514-c442f8409fab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:11.250506 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1de42543-26a9-4cac-9514-c442f8409fab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:11.250961 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1de42543-26a9-4cac-9514-c442f8409fab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:11.251737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1de42543-26a9-4cac-9514-c442f8409fab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:11.252213 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1de42543-26a9-4cac-9514-c442f8409fab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:11.276573 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-1de42543-26a9-4cac-9514-c442f8409fab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lazy-loading 'flavor' on Instance uuid ba7020d7-a1c8-41d2-8172-08a5c8438167 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:38:11.316768 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:11.514664 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5d81f1db-026d-41ff-b6e6-f54b701ec3ac tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:11.515539 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5d81f1db-026d-41ff-b6e6-f54b701ec3ac tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:11.524145 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d81f1db-026d-41ff-b6e6-f54b701ec3ac tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:11.524598 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d81f1db-026d-41ff-b6e6-f54b701ec3ac tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:11.525491 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d81f1db-026d-41ff-b6e6-f54b701ec3ac tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:11.525997 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d81f1db-026d-41ff-b6e6-f54b701ec3ac tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:11.531116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:11.561968 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1de42543-26a9-4cac-9514-c442f8409fab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/action" status: 202 len: 0 microversion: 2.20 time: 0.322727 Jun 04 18:38:11.566432 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 401/785] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 4 18:38:11 2022] POST /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:38:11.572190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:11.572886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:11.579866 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:11.580346 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:11.581110 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:11.581540 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:11.671415 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5d81f1db-026d-41ff-b6e6-f54b701ec3ac tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:11.679241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5d81f1db-026d-41ff-b6e6-f54b701ec3ac tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1453 microversion: 2.1 time: 0.169390 Jun 04 18:38:11.679908 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 385/786] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:11 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:11.695661 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0fd10dc6-719d-44f9-a206-0b456b1de3a3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:11.696298 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0fd10dc6-719d-44f9-a206-0b456b1de3a3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:11.702309 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fd10dc6-719d-44f9-a206-0b456b1de3a3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:11.702759 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fd10dc6-719d-44f9-a206-0b456b1de3a3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:11.703530 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fd10dc6-719d-44f9-a206-0b456b1de3a3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:11.703962 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fd10dc6-719d-44f9-a206-0b456b1de3a3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:11.717232 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:11.725503 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:11.727086 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:11.728284 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7154f224-62ea-4717-aba0-00a2d152371a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.160592 Jun 04 18:38:11.728876 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 402/787] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:11 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:38:11.833622 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0fd10dc6-719d-44f9-a206-0b456b1de3a3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:11.842123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0fd10dc6-719d-44f9-a206-0b456b1de3a3 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1453 microversion: 2.1 time: 0.150266 Jun 04 18:38:11.842690 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 386/788] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:11 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:12.747014 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:12.747632 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:12.754577 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:12.755019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:12.755791 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:12.756236 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:12.889162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:12.897782 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:12.900047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:12.901583 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9d70bdf7-86c2-4959-b186-c974b7aa28c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.158566 Jun 04 18:38:12.902144 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 403/789] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:12 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:13.267280 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e1006584-c940-4f07-92e1-84019a654d50 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:13.268293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e1006584-c940-4f07-92e1-84019a654d50 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:13.275494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1006584-c940-4f07-92e1-84019a654d50 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.275943 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1006584-c940-4f07-92e1-84019a654d50 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.276736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1006584-c940-4f07-92e1-84019a654d50 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.277169 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e1006584-c940-4f07-92e1-84019a654d50 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.312845 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e1006584-c940-4f07-92e1-84019a654d50 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049569 Jun 04 18:38:13.313648 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 387/790] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:38:13 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:38:13.424257 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4b0ebe60-f387-4ba4-a749-01efd3e5e336 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:13.425366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4b0ebe60-f387-4ba4-a749-01efd3e5e336 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:13.432362 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b0ebe60-f387-4ba4-a749-01efd3e5e336 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.432814 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b0ebe60-f387-4ba4-a749-01efd3e5e336 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.433599 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b0ebe60-f387-4ba4-a749-01efd3e5e336 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.434037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b0ebe60-f387-4ba4-a749-01efd3e5e336 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.466927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4b0ebe60-f387-4ba4-a749-01efd3e5e336 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046549 Jun 04 18:38:13.472160 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 404/791] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:38:13 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:38:13.531919 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ecf752a4-d84f-4420-b94a-ef9a04d012b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:13.532799 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ecf752a4-d84f-4420-b94a-ef9a04d012b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:13.539527 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ecf752a4-d84f-4420-b94a-ef9a04d012b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.540228 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ecf752a4-d84f-4420-b94a-ef9a04d012b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.540753 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ecf752a4-d84f-4420-b94a-ef9a04d012b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.541193 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ecf752a4-d84f-4420-b94a-ef9a04d012b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.568122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ecf752a4-d84f-4420-b94a-ef9a04d012b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:38:13.656689 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ecf752a4-d84f-4420-b94a-ef9a04d012b1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 204 len: 0 microversion: 2.1 time: 0.128230 Jun 04 18:38:13.660095 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 388/792] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:38:13 2022] DELETE /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:38:13.668220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a05c4597-e4ca-470e-a150-557e192a7285 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:13.669051 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a05c4597-e4ca-470e-a150-557e192a7285 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:13.676201 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a05c4597-e4ca-470e-a150-557e192a7285 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.676763 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a05c4597-e4ca-470e-a150-557e192a7285 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.677607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a05c4597-e4ca-470e-a150-557e192a7285 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.678101 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a05c4597-e4ca-470e-a150-557e192a7285 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.773395 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-6d39450f-bae8-48b3-b12f-3419dcb80d05 req-a37ac53a-5ed4-4a6c-ad67-11039c9bb053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf23d455-c4ee-41bb-b074-7a2e399fd8c0", "tag": "9892af68-c3a6-4862-855b-ea6a4e9a33c2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:38:13.781466 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-6d39450f-bae8-48b3-b12f-3419dcb80d05 req-a37ac53a-5ed4-4a6c-ad67-11039c9bb053 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.781904 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-6d39450f-bae8-48b3-b12f-3419dcb80d05 req-a37ac53a-5ed4-4a6c-ad67-11039c9bb053 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.793515 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-6d39450f-bae8-48b3-b12f-3419dcb80d05 req-a37ac53a-5ed4-4a6c-ad67-11039c9bb053 service nova] Creating event network-changed:9892af68-c3a6-4862-855b-ea6a4e9a33c2 for instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 on hv-cinder-79053 Jun 04 18:38:13.798720 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-6d39450f-bae8-48b3-b12f-3419dcb80d05 req-a37ac53a-5ed4-4a6c-ad67-11039c9bb053 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029253 Jun 04 18:38:13.800206 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 389/793] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:38:13.814350 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a05c4597-e4ca-470e-a150-557e192a7285 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:13.822603 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a05c4597-e4ca-470e-a150-557e192a7285 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1673 microversion: 2.1 time: 0.159324 Jun 04 18:38:13.823185 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 405/794] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:13 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:13.921817 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:13.922511 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:13.929292 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.929863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:13.931080 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:13.931520 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:14.062296 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:14.070517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:14.072030 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:14.073213 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2ad4ab92-01ab-42d4-ba31-19d6c48c4a9d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.155797 Jun 04 18:38:14.073740 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 390/795] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:13 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:14.840571 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-48228aba-70af-4772-8218-247a05d1de57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:14.841120 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-48228aba-70af-4772-8218-247a05d1de57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:14.847962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48228aba-70af-4772-8218-247a05d1de57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:14.848481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48228aba-70af-4772-8218-247a05d1de57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:14.849407 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48228aba-70af-4772-8218-247a05d1de57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:14.849923 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48228aba-70af-4772-8218-247a05d1de57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:14.988313 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-48228aba-70af-4772-8218-247a05d1de57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:14.998111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-48228aba-70af-4772-8218-247a05d1de57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1673 microversion: 2.1 time: 0.161543 Jun 04 18:38:14.998692 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 406/796] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:14 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:15.094903 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:15.095722 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:15.107076 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:15.107823 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:15.109149 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:15.109872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:15.255736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:15.264305 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:15.265793 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:15.266984 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b27114b4-570f-4aea-a264-830262ad5272 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.178755 Jun 04 18:38:15.267541 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 391/797] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:15 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:16.015207 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-211f498f-9f0b-4f1b-a776-f794ca5294a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:16.015759 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-211f498f-9f0b-4f1b-a776-f794ca5294a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:16.023113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-211f498f-9f0b-4f1b-a776-f794ca5294a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:16.024093 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-211f498f-9f0b-4f1b-a776-f794ca5294a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:16.024618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-211f498f-9f0b-4f1b-a776-f794ca5294a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:16.025065 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-211f498f-9f0b-4f1b-a776-f794ca5294a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:16.163300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-211f498f-9f0b-4f1b-a776-f794ca5294a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:16.171436 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-211f498f-9f0b-4f1b-a776-f794ca5294a3 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1673 microversion: 2.1 time: 0.160428 Jun 04 18:38:16.172063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 407/798] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:16 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:16.286587 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:16.287299 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:16.294371 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:16.295036 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:16.295905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:16.296430 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:16.512877 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:16.521411 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:16.522967 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:16.524529 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8a32942b-04f5-49cb-906d-9ef2ed1a6471 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.242845 Jun 04 18:38:16.525060 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 392/799] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:16 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:16.674325 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-b06d23e3-c21a-4238-ba7a-012e10ddfd4c req-6de2ce5d-46db-4406-8a8f-767c50047a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e757cd-3a43-458f-b9da-341ebfcc1bae", "name": "network-vif-deleted", "tag": "1d26581e-7d81-4913-9b38-a94dc05876e6"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:38:16.685938 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b06d23e3-c21a-4238-ba7a-012e10ddfd4c req-6de2ce5d-46db-4406-8a8f-767c50047a28 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:16.686457 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b06d23e3-c21a-4238-ba7a-012e10ddfd4c req-6de2ce5d-46db-4406-8a8f-767c50047a28 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:16.704041 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-b06d23e3-c21a-4238-ba7a-012e10ddfd4c req-6de2ce5d-46db-4406-8a8f-767c50047a28 service nova] Creating event network-vif-deleted:1d26581e-7d81-4913-9b38-a94dc05876e6 for instance d5e757cd-3a43-458f-b9da-341ebfcc1bae on hv-cinder-79053 Jun 04 18:38:16.710499 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-b06d23e3-c21a-4238-ba7a-012e10ddfd4c req-6de2ce5d-46db-4406-8a8f-767c50047a28 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041824 Jun 04 18:38:16.711518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 408/800] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:38:17.189958 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:17.190988 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:17.197693 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:17.198260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:17.199289 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:17.199743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:17.234692 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:17.235297 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:17.235960 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lazy-loading 'fault' on Instance uuid d5e757cd-3a43-458f-b9da-341ebfcc1bae {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:38:17.282187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb6c8f984d645dda88e2744f62a5213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a74defc69084b06b8d6300d1ce15bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:17.289625 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5ac2218d-7fd0-4e5d-a061-995e1fa93a57 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 200 len: 1327 microversion: 2.1 time: 0.104257 Jun 04 18:38:17.290477 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 393/801] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:17 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:38:17.543456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:17.544175 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:17.551223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:17.551732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:17.552550 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:17.552983 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:17.687289 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:17.696143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:17.697662 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:17.698831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6ce2808d-c932-41bf-8058-7f89472a1a3a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.159776 Jun 04 18:38:17.699394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 409/802] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:17 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:18.309222 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:18.309817 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:18.316871 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:18.317323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:18.318107 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:18.318548 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:18.333749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] HTTP exception thrown: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Request method failure captured: Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae HTTP/1.1 Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6Rq65JXOs6EZ0fhkc8vCyfJWKAqpL9g0zyONQ1BNzSQGqoii_htSz_A9L6ImtAQ6rLInn5JfMW9TYwePEfBGn1X5vdS77FMvkvmpoDCBm-yMrTftKCM45mF-Ai5_O7G923MCaEZa4sAOff2lVJV7QdGoQzMOj19C0KEfEawqc3Zz9A Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:38:18.335406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}] Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: bbb6c8f984d645dda88e2744f62a5213 Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:18.337141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'd5e757cd-3a43-458f-b9da-341ebfcc1bae'} Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:38:18.338028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:18.339370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:18.340976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Returning 404 to user: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:38:18.340976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bc82d8fa-7ebc-48b0-8d18-0455bf2865d1 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 404 len: 111 microversion: 2.1 time: 0.032242 Jun 04 18:38:18.340976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 394/803] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:18 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:38:18.346259 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a4f741dc-7dad-4640-bcf5-4779de03d74a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '.version_select at 0x7f467e7a0b80>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:18.364751 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a4f741dc-7dad-4640-bcf5-4779de03d74a tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162446738" status: 202 len: 0 microversion: 2.1 time: 0.022491 Jun 04 18:38:18.365317 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 410/804] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 4 18:38:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162446738 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:38:18.717362 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:18.717970 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:18.724219 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:18.724656 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:18.725441 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:18.725868 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:18.922204 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:18.930876 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:18.932445 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:18.933589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5251c6a6-0f51-4fb0-90a0-55db9c4d4ea2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.220275 Jun 04 18:38:18.934156 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 395/805] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:18 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:19.957777 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:19.959841 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:19.972485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:19.973397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:19.974690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:19.975422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:20.132514 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:20.141840 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:20.143341 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:20.144542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4a9337c4-89cf-4f42-8195-9b36aa060f4d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.194229 Jun 04 18:38:20.145147 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 411/806] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:19 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:21.167161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:21.167739 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:21.179781 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:21.180402 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:21.182036 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:21.182845 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:21.342449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:21.353934 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:21.356793 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:21.359080 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-95b177a7-46da-43c5-9e98-c291ecaafe05 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.197778 Jun 04 18:38:21.360122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 396/807] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:21 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:21.368270 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:21.369829 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:21.382099 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:21.382688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:21.383898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:21.384541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:21.400412 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] HTTP exception thrown: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Request method failure captured: Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae HTTP/1.1 Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6Rq65JXOs6EZ0fhkc8vCyfJWKAqpL9g0zyONQ1BNzSQGqoii_htSz_A9L6ImtAQ6rLInn5JfMW9TYwePEfBGn1X5vdS77FMvkvmpoDCBm-yMrTftKCM45mF-Ai5_O7G923MCaEZa4sAOff2lVJV7QdGoQzMOj19C0KEfEawqc3Zz9A Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:38:21.402223 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}] Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: bbb6c8f984d645dda88e2744f62a5213 Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.403728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'd5e757cd-3a43-458f-b9da-341ebfcc1bae'} Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:38:21.404539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.405758 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.406966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Returning 404 to user: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:38:21.406966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7418b5a7-f0d6-4843-96e6-83b8f74ae3c9 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 404 len: 111 microversion: 2.1 time: 0.044673 Jun 04 18:38:21.406966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 412/808] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:38:21 2022] DELETE /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 18:38:21.412765 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:21.413388 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: d5e757cd-3a43-458f-b9da-341ebfcc1bae] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:21.421017 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:21.421389 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:21.422177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:21.422615 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:21.440372 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] HTTP exception thrown: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Request method failure captured: Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae HTTP/1.1 Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6Rq65JXOs6EZ0fhkc8vCyfJWKAqpL9g0zyONQ1BNzSQGqoii_htSz_A9L6ImtAQ6rLInn5JfMW9TYwePEfBGn1X5vdS77FMvkvmpoDCBm-yMrTftKCM45mF-Ai5_O7G923MCaEZa4sAOff2lVJV7QdGoQzMOj19C0KEfEawqc3Zz9A Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:38:21.441905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}] Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: bbb6c8f984d645dda88e2744f62a5213 Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.443589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'd5e757cd-3a43-458f-b9da-341ebfcc1bae'} Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:38:21.444827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. Jun 04 18:38:21.446258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:21.447729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Returning 404 to user: Instance d5e757cd-3a43-458f-b9da-341ebfcc1bae could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:38:21.447729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6b992105-2cca-405d-ae39-3a9c7a82dc78 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae" status: 404 len: 111 microversion: 2.1 time: 0.034400 Jun 04 18:38:21.447729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 397/809] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:21 2022] GET /compute/v2.1/servers/d5e757cd-3a43-458f-b9da-341ebfcc1bae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:38:22.382469 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:22.383427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:22.392756 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:22.393202 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:22.393959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:22.394387 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:22.528655 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:22.537609 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:22.539089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:22.540272 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6e27b5de-0c71-4cfd-a466-1fc2638c82e1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.164494 Jun 04 18:38:22.540868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 413/810] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:22 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:22.597193 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:22.597723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:22.604681 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:22.605125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:22.605886 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:22.606316 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:22.620266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] HTTP exception thrown: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Request method failure captured: Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 HTTP/1.1 Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6Rq65JXOs6EZ0fhkc8vCyfJWKAqpL9g0zyONQ1BNzSQGqoii_htSz_A9L6ImtAQ6rLInn5JfMW9TYwePEfBGn1X5vdS77FMvkvmpoDCBm-yMrTftKCM45mF-Ai5_O7G923MCaEZa4sAOff2lVJV7QdGoQzMOj19C0KEfEawqc3Zz9A Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:38:22.621791 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}] Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: bbb6c8f984d645dda88e2744f62a5213 Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.623361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '84ac4261-d93e-474e-84f7-9941b02a97c3'} Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:38:22.624323 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.625837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.627266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Returning 404 to user: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:38:22.627266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6ab7156b-8d45-41c3-bbc1-eef77da3887b tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "DELETE /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 404 len: 111 microversion: 2.1 time: 0.029800 Jun 04 18:38:22.627266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 398/811] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:38:22 2022] DELETE /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:38:22.631637 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:22.632283 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] [instance: 84ac4261-d93e-474e-84f7-9941b02a97c3] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:22.638868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:22.639324 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:22.640102 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:22.640542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:22.654297 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] HTTP exception thrown: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Request method failure captured: Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 HTTP/1.1 Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6Rq65JXOs6EZ0fhkc8vCyfJWKAqpL9g0zyONQ1BNzSQGqoii_htSz_A9L6ImtAQ6rLInn5JfMW9TYwePEfBGn1X5vdS77FMvkvmpoDCBm-yMrTftKCM45mF-Ai5_O7G923MCaEZa4sAOff2lVJV7QdGoQzMOj19C0KEfEawqc3Zz9A Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:38:22.655859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a74defc69084b06b8d6300d1ce15bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a74defc69084b06b8d6300d1ce15bc5"}]}] Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 4a74defc69084b06b8d6300d1ce15bc5 Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeTestJSON-141715962 Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: bbb6c8f984d645dda88e2744f62a5213 Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeTestJSON-141715962-project Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.657422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '84ac4261-d93e-474e-84f7-9941b02a97c3'} Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:38:22.658668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. Jun 04 18:38:22.660113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:38:22.661496 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] Returning 404 to user: Instance 84ac4261-d93e-474e-84f7-9941b02a97c3 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:38:22.661496 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2d5dc6fa-82c2-4875-b8fa-3526ef4d6688 tempest-AttachVolumeTestJSON-141715962 tempest-AttachVolumeTestJSON-141715962-project] 10.222.0.39 "GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3" status: 404 len: 111 microversion: 2.1 time: 0.029492 Jun 04 18:38:22.661496 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 414/812] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:38:22 2022] GET /compute/v2.1/servers/84ac4261-d93e-474e-84f7-9941b02a97c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:38:23.559586 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:23.560146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:23.566603 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:23.567043 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:23.567817 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:23.568266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:23.712081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:23.721457 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:23.722772 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:23.723951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8222af88-d10b-4d5a-a493-985ea472e38b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1744 microversion: 2.20 time: 0.168903 Jun 04 18:38:23.724536 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 399/813] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:23 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:24.743032 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:24.743697 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:24.750768 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:24.751273 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:24.752447 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:24.752958 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:24.914984 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:24.927328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:24.929246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:24.930866 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-774443ce-a94e-45dd-b22b-0c51746f431c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1744 microversion: 2.20 time: 0.191887 Jun 04 18:38:24.943604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 415/814] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:24 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:25.951531 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:25.952168 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:25.959040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:25.959440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:25.960270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:25.960701 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:26.099434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:26.108568 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:26.110698 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:26.112115 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-feb06871-f589-4167-b742-f7847a718243 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1744 microversion: 2.20 time: 0.164825 Jun 04 18:38:26.112745 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 400/815] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:25 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:26.842080 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-bdfd94f7-a424-4908-9c8b-2fd96f7eb6b2 req-af7668c1-875e-422e-81bd-395e52495a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7020d7-a1c8-41d2-8172-08a5c8438167", "name": "network-vif-plugged", "status": "completed", "tag": "c0785036-2e03-4588-a648-bccd3d33560a"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:38:26.846590 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:26.854062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-bdfd94f7-a424-4908-9c8b-2fd96f7eb6b2 req-af7668c1-875e-422e-81bd-395e52495a30 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:26.854732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-bdfd94f7-a424-4908-9c8b-2fd96f7eb6b2 req-af7668c1-875e-422e-81bd-395e52495a30 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:26.868583 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-bdfd94f7-a424-4908-9c8b-2fd96f7eb6b2 req-af7668c1-875e-422e-81bd-395e52495a30 service nova] Creating event network-vif-plugged:c0785036-2e03-4588-a648-bccd3d33560a for instance ba7020d7-a1c8-41d2-8172-08a5c8438167 on hv-cinder-79053 Jun 04 18:38:26.874510 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-bdfd94f7-a424-4908-9c8b-2fd96f7eb6b2 req-af7668c1-875e-422e-81bd-395e52495a30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036700 Jun 04 18:38:26.875298 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 416/816] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:38:27.131377 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:27.132040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:27.139746 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:27.140161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:27.141088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:27.141359 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:27.278763 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:27.287618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:27.289236 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:27.290481 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-238b4093-a6e3-4b7f-93d9-59c8d86dd6ba tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1744 microversion: 2.20 time: 0.163121 Jun 04 18:38:27.291411 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 401/817] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:27 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:28.310826 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:28.311524 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:28.317989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:28.318445 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:28.319214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:28.319653 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:28.459895 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:28.468972 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:28.470452 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:28.471661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d2297c51-25b4-4ac4-a333-e8c086005ffe tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1744 microversion: 2.20 time: 0.165879 Jun 04 18:38:28.472240 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 417/818] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:28 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:29.493782 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:29.494475 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:29.497342 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:29.503315 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:29.503818 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:29.504617 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:29.504955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:29.523769 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:29.639978 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:29.648394 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:29.649879 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:29.651048 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c5874ed9-b12d-40d4-90a1-68c67400d0b5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1744 microversion: 2.20 time: 0.163814 Jun 04 18:38:29.651807 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 402/819] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:29 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:30.679898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:30.686821 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:30.697367 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:30.697893 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:30.698787 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:30.699354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:30.865517 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:30.874255 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:30.875819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:30.877016 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8dd1bc97-a833-4356-ba3c-70bfc8539534 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1739 microversion: 2.20 time: 0.211176 Jun 04 18:38:30.881351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 418/820] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:30 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:31.899460 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:31.900258 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:31.909742 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:31.910227 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:31.911017 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:31.911456 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:32.138707 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:32.150754 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:32.152721 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:32.155098 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a9db5b9d-1b77-4806-8ab7-c5f42f7e7452 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1739 microversion: 2.20 time: 0.259678 Jun 04 18:38:32.156701 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 403/821] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:31 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:33.174251 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:33.174865 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:33.181960 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:33.182956 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:33.184305 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:33.185121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:33.329060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:33.338011 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:33.339554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:33.341061 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-abeebf95-a696-4e1e-9785-612591b41d3e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1739 microversion: 2.20 time: 0.170716 Jun 04 18:38:33.342006 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 419/822] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:33 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:34.363256 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:34.365013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:34.373212 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:34.374490 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:34.375951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:34.376669 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:34.531177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:34.541029 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:34.543182 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:34.544802 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9178f6b2-da18-4629-88d4-0c63c5b24dcf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1739 microversion: 2.20 time: 0.188510 Jun 04 18:38:34.545742 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 404/823] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:34 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:38:35.563395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:35.563988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:35.571047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:35.571575 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:35.572446 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:35.572887 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:35.726453 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:35.730212 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:35.735849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:35.737604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:35.738785 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e7a7cf36-4228-4033-bca4-91cf96125ae2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1739 microversion: 2.20 time: 0.179845 Jun 04 18:38:35.739342 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 420/824] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:35 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:36.757274 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:36.757955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:36.765992 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:36.766449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:36.767697 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:36.768694 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:36.925909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:36.937145 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:36.938787 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:36.939931 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cd3d4114-957c-4cf3-a6e8-b803917195c2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1739 microversion: 2.20 time: 0.187015 Jun 04 18:38:36.940512 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 405/825] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:36 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:37.959512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:37.960775 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:37.974423 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:37.974886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:37.975694 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:37.979160 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:38.149847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:38.161812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:38.163468 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:38.164962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-de1272d5-52c4-496a-9c41-53cc1a0cc89f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1739 microversion: 2.20 time: 0.209664 Jun 04 18:38:38.175760 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 421/826] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:37 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:39.185350 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:39.187444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:39.199810 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:39.200831 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:39.201853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:39.202907 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:39.366077 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:39.376966 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:39.379500 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:39.380872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-266e1d42-15d0-4b1f-8b43-ec06266c84b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1739 microversion: 2.20 time: 0.201976 Jun 04 18:38:39.381515 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 406/827] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:39 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:40.399315 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:40.399959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:40.407693 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:40.408519 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:40.409294 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:40.409734 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:40.556139 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:40.565142 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:40.566652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:40.567859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b949e0e6-c5d9-4ee3-b87c-3da55dd7034c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1739 microversion: 2.20 time: 0.172823 Jun 04 18:38:40.568608 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 422/828] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:40 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:41.586857 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:41.587470 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:41.594409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:41.594853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:41.595613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:41.596050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:41.823584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:41.827523 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:41.829209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:41.830610 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-79363337-cd5b-4bed-a0c2-4cc1c7433b79 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1721 microversion: 2.20 time: 0.247712 Jun 04 18:38:41.831286 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 407/829] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:41 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:42.853791 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:42.854768 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:42.866250 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:42.866995 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:42.868324 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:42.869046 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:43.006422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:43.014927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:43.016443 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:43.017598 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2935636e-8607-45d4-82dc-f2ed38e3e88a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1721 microversion: 2.20 time: 0.170519 Jun 04 18:38:43.018150 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 423/830] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:42 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:38:44.038547 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:44.039167 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:44.046861 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:44.047312 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:44.048103 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:44.048550 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:44.353217 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:44.365370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:44.367398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:44.368898 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b5abe5a6-d2ca-4e4d-915b-0a9a035809b2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1664 microversion: 2.20 time: 0.334201 Jun 04 18:38:44.369629 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 408/831] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:44 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1664 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:44.388714 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-97f37295-4790-4a65-a48e-988596e1c6ad tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18643a0f-49a4-4a99-848b-d2470183000e"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:38:44.389991 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-97f37295-4790-4a65-a48e-988596e1c6ad tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:44.397977 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97f37295-4790-4a65-a48e-988596e1c6ad tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:44.398664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97f37295-4790-4a65-a48e-988596e1c6ad tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:44.399619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97f37295-4790-4a65-a48e-988596e1c6ad tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:44.400176 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97f37295-4790-4a65-a48e-988596e1c6ad tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:44.706751 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-97f37295-4790-4a65-a48e-988596e1c6ad tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323112 Jun 04 18:38:44.707399 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 424/832] 10.222.0.39 () {62 vars in 1363 bytes} [Sat Jun 4 18:38:44 2022] POST /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:38:44.836670 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-125735e5-ed3e-4ad8-ad9b-b125c0631201 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:38:44.837403 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-125735e5-ed3e-4ad8-ad9b-b125c0631201 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:44.845980 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-125735e5-ed3e-4ad8-ad9b-b125c0631201 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:44.846647 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-125735e5-ed3e-4ad8-ad9b-b125c0631201 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:44.847657 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-125735e5-ed3e-4ad8-ad9b-b125c0631201 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:44.848399 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-125735e5-ed3e-4ad8-ad9b-b125c0631201 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:44.884133 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-929961a1-f3c0-44b4-b206-cea05138639d req-89c6e9ee-0866-4cda-a57f-8b5e80ca5504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7020d7-a1c8-41d2-8172-08a5c8438167", "name": "network-vif-unplugged", "status": "completed", "tag": "c0785036-2e03-4588-a648-bccd3d33560a"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:38:44.895219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-929961a1-f3c0-44b4-b206-cea05138639d req-89c6e9ee-0866-4cda-a57f-8b5e80ca5504 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:44.895917 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-929961a1-f3c0-44b4-b206-cea05138639d req-89c6e9ee-0866-4cda-a57f-8b5e80ca5504 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:44.907425 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.compute.server_external_events [req-929961a1-f3c0-44b4-b206-cea05138639d req-89c6e9ee-0866-4cda-a57f-8b5e80ca5504 service nova] Unable to find a host for instance ba7020d7-a1c8-41d2-8172-08a5c8438167. Dropping event network-vif-unplugged {{(pid=117732) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 18:38:44.909207 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-929961a1-f3c0-44b4-b206-cea05138639d req-89c6e9ee-0866-4cda-a57f-8b5e80ca5504 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028732 Jun 04 18:38:44.910281 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 425/833] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 04 18:38:44.949769 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-125735e5-ed3e-4ad8-ad9b-b125c0631201 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/action" status: 202 len: 0 microversion: 2.20 time: 0.117069 Jun 04 18:38:44.951449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 409/834] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 4 18:38:44 2022] POST /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:38:44.958589 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:44.959330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:44.965709 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:44.966274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:44.967065 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:44.967478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:45.107423 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:45.115865 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:45.117404 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:45.118622 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e58f4548-6a71-4373-b7c5-7e9d3a3ab0b6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1750 microversion: 2.20 time: 0.163960 Jun 04 18:38:45.119186 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 426/835] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:44 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:46.137938 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:46.138695 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:46.145862 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:46.146212 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:46.147124 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:46.147543 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:46.334952 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:46.343643 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:46.345186 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:46.346362 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8d5191fd-3ca7-4b46-8d31-9d756605143b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1752 microversion: 2.20 time: 0.213393 Jun 04 18:38:46.346902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 410/836] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:46 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:47.365254 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:47.366559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:47.373762 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:47.374187 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:47.375325 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:47.375761 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:47.570805 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:47.580211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:47.581714 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:47.582882 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b4839bbb-7522-492a-b10c-33c0f8204640 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.221771 Jun 04 18:38:47.583403 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 427/837] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:47 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:38:48.601697 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:48.602305 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:48.620091 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:48.620828 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:48.624417 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:48.627418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:48.853073 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:48.869714 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:48.871820 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:48.873361 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fa523a0d-fb0f-4321-b65f-a96d88c7d342 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.275599 Jun 04 18:38:48.874453 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 411/838] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:48 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:49.900767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:49.901397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:49.930397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:49.930892 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:49.932160 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:49.932610 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:50.088238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:50.101235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:50.103082 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:50.104356 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7d484936-a9af-4481-99c6-fae9f1c9c4c0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.215366 Jun 04 18:38:50.104941 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 428/839] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:49 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:51.123448 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:51.124336 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:51.135310 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:51.135768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:51.137265 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:51.137963 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:51.516997 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:51.526254 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:51.528432 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:51.529620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8cf03345-80ea-49e0-9fba-ad4be63ae5cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.410678 Jun 04 18:38:51.530172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 412/840] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:51 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:52.550008 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:52.551383 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:52.559793 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:52.560553 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:52.561549 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:52.562167 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:52.825929 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:52.834661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:52.836214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:52.837523 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b8318ff7-6ca1-4c67-905f-ff4739f1da01 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.292193 Jun 04 18:38:52.838080 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 429/841] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:52 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:53.857774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:53.858383 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:53.865469 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:53.865912 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:53.866720 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:53.867153 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:54.006716 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:54.015874 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:54.017379 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:54.018534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4f483122-5269-4b55-844f-55334890cc09 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.165541 Jun 04 18:38:54.019083 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 413/842] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:53 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:55.038395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:55.039017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:55.047606 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:55.048189 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:55.049175 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:55.049684 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:55.228935 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:55.244219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:55.246063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:55.248663 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2f953089-a2f8-4d81-8e02-9302dd5ce53d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.214480 Jun 04 18:38:55.250072 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 430/843] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:55 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:56.268872 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:56.269739 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:56.276909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:56.277364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:56.278265 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:56.278705 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:56.432768 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:56.442015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:56.443496 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:56.444689 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-178bdebe-046c-485f-bbf8-6a3a6b325f06 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.181483 Jun 04 18:38:56.445243 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 414/844] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:56 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:57.464809 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:57.465594 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:57.468386 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=30 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:57.473966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:57.474621 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:57.475528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:57.475817 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:57.635763 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:57.645005 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:57.646492 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:57.647644 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bb16b778-afbb-490f-85f9-78a1f3fa8678 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.186996 Jun 04 18:38:57.648228 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 431/845] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:57 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:58.671771 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:58.673164 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:58.684563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:58.685460 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:58.686391 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:58.686822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:58.818859 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:58.828045 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:58.829532 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:38:58.830688 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-10f60e97-2615-47c9-998a-5d733d839c33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.165785 Jun 04 18:38:58.831277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 415/846] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:58 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:38:59.854381 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:38:59.855327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:38:59.865879 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:59.866618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:38:59.867863 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:38:59.868654 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:00.005943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:00.019153 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:00.021559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:00.023287 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d505559a-4c2d-4489-bf69-862926c40976 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.175595 Jun 04 18:39:00.024063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 432/847] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:38:59 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:01.047967 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:01.048664 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:01.051178 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=30 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:01.057209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:01.057704 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:01.058544 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:01.059024 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:01.062534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:01.205209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:01.213932 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:01.215421 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:01.216604 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dc7d3b67-8663-4d91-9e7b-0688aa769e33 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.174717 Jun 04 18:39:01.217363 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 416/848] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:01 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:02.235227 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:02.235971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:02.243021 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:02.243466 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:02.244263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:02.244694 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:02.389768 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:02.398746 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:02.400267 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:02.401460 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-03f29e54-8d52-40df-9fa1-bf7d64e6fe5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.170353 Jun 04 18:39:02.402052 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 433/849] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:02 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:03.424634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:03.425372 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:03.433733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:03.434300 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:03.435248 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:03.435793 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:03.570011 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:03.578535 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:03.580634 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:03.581797 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f4cab7f5-21e0-49a4-8241-ac28147cc3f6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.162692 Jun 04 18:39:03.582386 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 417/850] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:03 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:04.600608 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:04.601211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:04.608034 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:04.608520 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:04.609284 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:04.609712 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:04.744491 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:04.752974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:04.754725 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:04.755892 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-05bbbc17-d11c-407f-a7b7-30c8fff0a2d3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.159571 Jun 04 18:39:04.756527 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 434/851] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:04 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:05.775037 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:05.775825 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:05.783012 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:05.783933 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:05.784813 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:05.785319 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:05.987978 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:05.997226 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:05.998738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:05.999919 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a9ffdb80-f22b-45ab-9f9f-fae39576d849 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.229562 Jun 04 18:39:06.000508 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 418/852] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:05 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:07.019232 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:07.019828 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:07.027388 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:07.027931 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:07.028826 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:07.029276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:07.047950 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:07.164674 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:07.173301 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:07.174898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:07.175972 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-75ca3d4d-5169-475c-83b6-b693ea6d60eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.160924 Jun 04 18:39:07.176737 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 435/853] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:07 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:08.195451 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:08.196051 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:08.202586 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:08.203029 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:08.203814 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:08.204266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:08.342484 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:08.351896 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:08.353409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:08.354570 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-151f5aef-f297-4319-90f5-f3b45bf45a7f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.164099 Jun 04 18:39:08.355115 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 419/854] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:08 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:09.372983 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:09.374182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:09.381200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:09.381849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:09.382786 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:09.383225 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:09.628582 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:09.638023 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:09.639707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:09.641092 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-daea18eb-cffa-4f94-975d-e250d854fd3c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.272086 Jun 04 18:39:09.641885 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 436/855] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:09 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:39:10.661390 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:10.662003 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:10.669485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:10.669942 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:10.670719 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:10.671158 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:10.816144 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:10.825320 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:10.827033 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:10.828295 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b95bedd1-d4ad-43cc-bade-55d2c995030e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.172225 Jun 04 18:39:10.828918 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 420/856] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:10 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:11.847430 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:11.848250 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:11.863162 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:11.864158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:11.865389 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:11.866044 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:12.100325 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:12.110604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:12.112416 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:12.113564 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ab294f91-cc3f-45fa-ab0a-17af2469d4eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.270545 Jun 04 18:39:12.114532 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 437/857] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:11 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:13.134486 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:13.135379 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:13.149926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:13.150756 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:13.151800 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:13.152489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:13.385265 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:13.397519 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:13.399021 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:13.403426 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-996a0657-244c-4cdb-9d7c-91cdf52c8351 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.273197 Jun 04 18:39:13.404054 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 421/858] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:13 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:14.423440 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:14.425060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:14.432998 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:14.434057 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:14.435152 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:14.436173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:14.601635 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:14.610837 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:14.612398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:14.613615 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5ccd2141-fb3d-40d4-a380-5e6bbda9a791 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.194972 Jun 04 18:39:14.614537 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 438/859] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:14 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:15.117586 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-dd01ee86-668f-4772-977d-092e41268f45 req-fd676fb7-48d5-4689-b993-2b1350ffbf8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7020d7-a1c8-41d2-8172-08a5c8438167", "name": "network-vif-plugged", "status": "completed", "tag": "c0785036-2e03-4588-a648-bccd3d33560a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:39:15.128380 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-dd01ee86-668f-4772-977d-092e41268f45 req-fd676fb7-48d5-4689-b993-2b1350ffbf8c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:15.129086 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-dd01ee86-668f-4772-977d-092e41268f45 req-fd676fb7-48d5-4689-b993-2b1350ffbf8c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:15.142195 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-dd01ee86-668f-4772-977d-092e41268f45 req-fd676fb7-48d5-4689-b993-2b1350ffbf8c service nova] Creating event network-vif-plugged:c0785036-2e03-4588-a648-bccd3d33560a for instance ba7020d7-a1c8-41d2-8172-08a5c8438167 on hv-cinder-79053 Jun 04 18:39:15.149797 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-dd01ee86-668f-4772-977d-092e41268f45 req-fd676fb7-48d5-4689-b993-2b1350ffbf8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036263 Jun 04 18:39:15.150512 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 422/860] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:39:15.634548 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:15.635185 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:15.650300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:15.650772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:15.659196 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:15.665535 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:16.021544 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:16.041253 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:16.049839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:16.051081 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cc837d3c-41ac-4aec-9f1a-4b574b3fe19b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.422318 Jun 04 18:39:16.070497 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 439/861] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:15 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:17.083615 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:17.084970 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:17.110546 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:17.111284 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:17.114897 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:17.119059 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:17.463231 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:17.474590 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:17.476120 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:17.477537 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e39f82d9-0f55-40c8-9221-5528883a92ce tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.402727 Jun 04 18:39:17.478091 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 423/862] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:17 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:18.423518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5444f317-d775-43f3-a284-0f809f17ad85 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Action: 'create', calling method: .version_select at 0x7f467e6d1700>, body: {"keypair": {"name": "tempest-TestShelveInstance-5573208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYf2SxBfuPcWsI7yLOFgKWZmgIO/S72OLZ40163iqQxXspzprZ6lEocux7E6ekdmtrh+rQY/txPyD9khLifIZCjvrE0ncuygeVuHokL1j//wadSZvxOlveag6Jou/jNHw=="}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:39:18.440434 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-5444f317-d775-43f3-a284-0f809f17ad85 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Getting quotas for project b1701547610945ceac41e94e733f61a1. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:39:18.444608 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-5444f317-d775-43f3-a284-0f809f17ad85 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Getting quotas for user 308d60778a0e489491cd6b3a79c96385 and project b1701547610945ceac41e94e733f61a1. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:39:18.474986 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5444f317-d775-43f3-a284-0f809f17ad85 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.267732 Jun 04 18:39:18.476044 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 440/863] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 4 18:39:18 2022] POST /compute/v2.1/os-keypairs => generated 394 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:39:18.498334 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:18.499135 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:18.506197 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:18.506653 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:18.507464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:18.508110 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:18.720699 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:18.730714 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:18.732583 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:18.733965 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-28757840-24a7-4ba2-99a8-8e5422bcd5ab tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1808 microversion: 2.20 time: 0.241330 Jun 04 18:39:18.734706 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 424/864] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:18 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:19.752899 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:19.753785 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:19.761903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:19.762399 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:19.763180 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:19.763621 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:19.905495 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:19.919443 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:19.921006 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:19.922395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-62280861-7d11-41f7-a402-499ee7450bed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1795 microversion: 2.20 time: 0.173689 Jun 04 18:39:19.923459 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 441/865] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:39:19 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1795 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:39:22.420159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-69316338-d75f-44a2-a15c-1396b6edaa26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:22.422014 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-69316338-d75f-44a2-a15c-1396b6edaa26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:22.430592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69316338-d75f-44a2-a15c-1396b6edaa26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:22.431038 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69316338-d75f-44a2-a15c-1396b6edaa26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:22.431960 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69316338-d75f-44a2-a15c-1396b6edaa26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:22.432853 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69316338-d75f-44a2-a15c-1396b6edaa26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:22.464429 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-69316338-d75f-44a2-a15c-1396b6edaa26 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/ips" status: 200 len: 149 microversion: 2.1 time: 0.050399 Jun 04 18:39:22.472332 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 425/866] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 4 18:39:22 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:39:23.852050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8077f065-2d70-4752-a6c4-25a8f9661171 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38e01975-5371-4e69-8d99-7c656d4dd9d6"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:39:23.853370 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8077f065-2d70-4752-a6c4-25a8f9661171 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:23.861019 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8077f065-2d70-4752-a6c4-25a8f9661171 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:23.861475 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8077f065-2d70-4752-a6c4-25a8f9661171 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:23.862264 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8077f065-2d70-4752-a6c4-25a8f9661171 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:23.862703 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8077f065-2d70-4752-a6c4-25a8f9661171 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:24.129287 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8077f065-2d70-4752-a6c4-25a8f9661171 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "POST /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281623 Jun 04 18:39:24.129897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 442/867] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 4 18:39:23 2022] POST /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:39:31.796504 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-68d4e7ce-b467-4a4a-8b08-c6a493e1f9cd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:31.797070 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-68d4e7ce-b467-4a4a-8b08-c6a493e1f9cd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:31.800678 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=20 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:31.806592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-68d4e7ce-b467-4a4a-8b08-c6a493e1f9cd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:31.807035 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-68d4e7ce-b467-4a4a-8b08-c6a493e1f9cd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:31.807793 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-68d4e7ce-b467-4a4a-8b08-c6a493e1f9cd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:31.808252 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-68d4e7ce-b467-4a4a-8b08-c6a493e1f9cd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:31.810889 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=54 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:31.899688 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-68d4e7ce-b467-4a4a-8b08-c6a493e1f9cd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lazy-loading 'services' on Instance uuid 828b8f27-8e5e-423e-9dcc-1e045936637c {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:39:31.978613 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-68d4e7ce-b467-4a4a-8b08-c6a493e1f9cd tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-volume_attachments/38e01975-5371-4e69-8d99-7c656d4dd9d6" status: 202 len: 0 microversion: 2.1 time: 0.188244 Jun 04 18:39:31.979185 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 426/868] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 4 18:39:31 2022] DELETE /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-volume_attachments/38e01975-5371-4e69-8d99-7c656d4dd9d6 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:39:31.985385 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=4 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:31.990626 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e13a34d5-8c4d-440c-a5c9-6b60db487168 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:31.991661 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e13a34d5-8c4d-440c-a5c9-6b60db487168 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:31.993935 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:32.000536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e13a34d5-8c4d-440c-a5c9-6b60db487168 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:32.000996 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e13a34d5-8c4d-440c-a5c9-6b60db487168 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:32.001819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e13a34d5-8c4d-440c-a5c9-6b60db487168 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:32.002337 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e13a34d5-8c4d-440c-a5c9-6b60db487168 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:32.038192 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e13a34d5-8c4d-440c-a5c9-6b60db487168 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054230 Jun 04 18:39:32.038753 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 443/869] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:39:31 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:39:33.056923 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-63bd28fd-50ac-40fa-a316-021be77d9702 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:33.058664 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-63bd28fd-50ac-40fa-a316-021be77d9702 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:33.069165 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63bd28fd-50ac-40fa-a316-021be77d9702 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:33.069620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63bd28fd-50ac-40fa-a316-021be77d9702 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:33.070403 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63bd28fd-50ac-40fa-a316-021be77d9702 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:33.070881 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63bd28fd-50ac-40fa-a316-021be77d9702 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:33.106737 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-63bd28fd-50ac-40fa-a316-021be77d9702 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058378 Jun 04 18:39:33.107311 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 427/870] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 4 18:39:33 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 18:39:33.177385 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-728b6846-1043-45ae-a2ab-ed180f7bd6f3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:33.177936 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-728b6846-1043-45ae-a2ab-ed180f7bd6f3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:33.184884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-728b6846-1043-45ae-a2ab-ed180f7bd6f3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:33.185342 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-728b6846-1043-45ae-a2ab-ed180f7bd6f3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:33.186119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-728b6846-1043-45ae-a2ab-ed180f7bd6f3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:33.186556 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-728b6846-1043-45ae-a2ab-ed180f7bd6f3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:33.212428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-728b6846-1043-45ae-a2ab-ed180f7bd6f3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:39:33.296030 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-728b6846-1043-45ae-a2ab-ed180f7bd6f3 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 204 len: 0 microversion: 2.1 time: 0.122288 Jun 04 18:39:33.296934 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 444/871] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:39:33 2022] DELETE /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:39:33.305903 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ab1b84cf-8190-46c5-a565-66716877ce9d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:33.306520 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ab1b84cf-8190-46c5-a565-66716877ce9d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:33.312919 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab1b84cf-8190-46c5-a565-66716877ce9d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:33.313362 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab1b84cf-8190-46c5-a565-66716877ce9d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:33.314120 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab1b84cf-8190-46c5-a565-66716877ce9d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:33.314551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab1b84cf-8190-46c5-a565-66716877ce9d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:33.449606 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ab1b84cf-8190-46c5-a565-66716877ce9d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:33.457411 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ab1b84cf-8190-46c5-a565-66716877ce9d tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1682 microversion: 2.1 time: 0.156038 Jun 04 18:39:33.458044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 428/872] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:33 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:34.478691 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-163075c3-5fc9-4a5e-864f-80f3ee7c2a7b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:34.479481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-163075c3-5fc9-4a5e-864f-80f3ee7c2a7b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:34.488186 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-163075c3-5fc9-4a5e-864f-80f3ee7c2a7b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:34.488764 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-163075c3-5fc9-4a5e-864f-80f3ee7c2a7b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:34.489878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-163075c3-5fc9-4a5e-864f-80f3ee7c2a7b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:34.490686 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-163075c3-5fc9-4a5e-864f-80f3ee7c2a7b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:34.633755 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-163075c3-5fc9-4a5e-864f-80f3ee7c2a7b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:34.642178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-163075c3-5fc9-4a5e-864f-80f3ee7c2a7b tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1682 microversion: 2.1 time: 0.169546 Jun 04 18:39:34.642756 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 445/873] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:34 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:35.664348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ae1c7dcf-3c9f-4b02-ae27-b75cd10fdc55 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:35.664918 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ae1c7dcf-3c9f-4b02-ae27-b75cd10fdc55 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:35.671992 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ae1c7dcf-3c9f-4b02-ae27-b75cd10fdc55 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:35.672467 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ae1c7dcf-3c9f-4b02-ae27-b75cd10fdc55 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:35.673230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ae1c7dcf-3c9f-4b02-ae27-b75cd10fdc55 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:35.673660 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ae1c7dcf-3c9f-4b02-ae27-b75cd10fdc55 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:35.823726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ae1c7dcf-3c9f-4b02-ae27-b75cd10fdc55 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:35.835405 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ae1c7dcf-3c9f-4b02-ae27-b75cd10fdc55 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1682 microversion: 2.1 time: 0.175091 Jun 04 18:39:35.836120 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 429/874] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:35 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:36.834870 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-d0fa0787-15a2-42e9-b135-8c7464d1c682 req-8f502a95-ff98-4965-827a-04b760b0e687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828b8f27-8e5e-423e-9dcc-1e045936637c", "name": "network-vif-deleted", "tag": "3a8784e0-838e-4cc7-a4d9-cc19d7dfd5ac"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:39:36.845591 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d0fa0787-15a2-42e9-b135-8c7464d1c682 req-8f502a95-ff98-4965-827a-04b760b0e687 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:36.846354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d0fa0787-15a2-42e9-b135-8c7464d1c682 req-8f502a95-ff98-4965-827a-04b760b0e687 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:36.858086 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:36.858824 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:36.863790 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-d0fa0787-15a2-42e9-b135-8c7464d1c682 req-8f502a95-ff98-4965-827a-04b760b0e687 service nova] Creating event network-vif-deleted:3a8784e0-838e-4cc7-a4d9-cc19d7dfd5ac for instance 828b8f27-8e5e-423e-9dcc-1e045936637c on hv-cinder-79053 Jun 04 18:39:36.868124 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:36.868594 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:36.869503 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:36.869945 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:36.870572 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-d0fa0787-15a2-42e9-b135-8c7464d1c682 req-8f502a95-ff98-4965-827a-04b760b0e687 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112286 Jun 04 18:39:36.871701 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 446/875] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:39:36.911055 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:36.912066 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:36.912856 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lazy-loading 'fault' on Instance uuid 828b8f27-8e5e-423e-9dcc-1e045936637c {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:39:36.978232 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5a9f5cdfa6494d97617d68880d5552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71dff5ee406141ec8e0d4a9b58106610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:36.986593 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e95b006c-48c5-4f4e-aa3d-6e10d1e08cce tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 200 len: 1332 microversion: 2.1 time: 0.133588 Jun 04 18:39:36.987752 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 430/876] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:36 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:39:38.009513 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:38.010333 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:38.018151 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:38.018606 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:38.019503 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:38.020051 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:38.023767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:38.039464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c HTTP/1.1 Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:39:38.041116 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:38.042769 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '828b8f27-8e5e-423e-9dcc-1e045936637c'} Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:39:38.043735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:38.046880 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:38.048399 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:39:38.048399 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e1f4af04-7420-4c7c-8382-dd61059c7cc1 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 404 len: 111 microversion: 2.1 time: 0.040373 Jun 04 18:39:38.048399 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 447/877] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:38 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:39:38.051633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5b997aba-4254-4688-a48b-22ad38b3d6bb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '.version_select at 0x7f467dfb6820>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:38.071953 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5b997aba-4254-4688-a48b-22ad38b3d6bb tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613977476" status: 202 len: 0 microversion: 2.1 time: 0.024124 Jun 04 18:39:38.072697 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 431/878] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 4 18:39:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613977476 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:39:39.840218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:39.840745 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:39.847897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:39.848404 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:39.849181 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:39.849590 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:39.863926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c HTTP/1.1 Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:39:39.865592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.867143 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '828b8f27-8e5e-423e-9dcc-1e045936637c'} Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:39:39.868063 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.869518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.871017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:39:39.871017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-70afe975-f1b5-4bb3-b0a8-464bd95f02b9 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 404 len: 111 microversion: 2.1 time: 0.031077 Jun 04 18:39:39.871017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 448/879] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:39:39 2022] DELETE /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:39:39.876829 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:39.877440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 828b8f27-8e5e-423e-9dcc-1e045936637c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:39.885302 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:39.885851 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:39.886725 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:39.887217 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:39.901913 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c HTTP/1.1 Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:39:39.903609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.905346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '828b8f27-8e5e-423e-9dcc-1e045936637c'} Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:39:39.906489 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. Jun 04 18:39:39.907976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:39.909773 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance 828b8f27-8e5e-423e-9dcc-1e045936637c could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:39:39.909773 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7a8cf191-53bc-4378-85ed-a01123d8bc37 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c" status: 404 len: 111 microversion: 2.1 time: 0.032650 Jun 04 18:39:39.909773 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 432/880] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:39 2022] GET /compute/v2.1/servers/828b8f27-8e5e-423e-9dcc-1e045936637c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:39:41.048982 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:41.049581 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:41.056846 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:41.057290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:41.058051 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:41.058482 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:41.071871 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 HTTP/1.1 Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:39:41.073427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.074992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'b570f772-6dc1-446e-9bdb-4368b8e409b4'} Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:39:41.075947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.077464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.079173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:39:41.079173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-97735eee-20b0-46fc-bd16-4ba73938a123 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 404 len: 111 microversion: 2.1 time: 0.030128 Jun 04 18:39:41.079173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 449/881] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:39:41 2022] DELETE /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:39:41.083170 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:41.083991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: b570f772-6dc1-446e-9bdb-4368b8e409b4] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:41.090380 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:41.090821 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:41.091574 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:41.092041 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:41.105263 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 HTTP/1.1 Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:39:41.106755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.108278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'b570f772-6dc1-446e-9bdb-4368b8e409b4'} Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:39:41.109081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. Jun 04 18:39:41.110281 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.111345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance b570f772-6dc1-446e-9bdb-4368b8e409b4 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:39:41.111345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1615b47b-c3de-4a48-bf61-cd695a9e18e8 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4" status: 404 len: 111 microversion: 2.1 time: 0.028773 Jun 04 18:39:41.111345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 433/882] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:41 2022] GET /compute/v2.1/servers/b570f772-6dc1-446e-9bdb-4368b8e409b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:39:41.116644 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:41.117141 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:41.123534 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:41.123978 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:41.124761 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:41.125198 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:41.138706 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 HTTP/1.1 Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:39:41.140321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.141894 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '1205f37f-ca68-4d25-83e9-ad88c6f52c54'} Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:39:41.142739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.144200 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.145598 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:39:41.145598 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-805e441b-c586-4394-9205-ab954c397286 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 404 len: 111 microversion: 2.1 time: 0.028998 Jun 04 18:39:41.145598 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 450/883] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:39:41 2022] DELETE /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:39:41.149957 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:41.150561 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: 1205f37f-ca68-4d25-83e9-ad88c6f52c54] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:41.156746 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:41.157192 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:41.157946 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:41.158382 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:41.172228 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 HTTP/1.1 Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:39:41.173723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.175270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '1205f37f-ca68-4d25-83e9-ad88c6f52c54'} Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:39:41.176198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. Jun 04 18:39:41.177826 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:39:41.179161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance 1205f37f-ca68-4d25-83e9-ad88c6f52c54 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:39:41.179161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e9d0f935-459c-42d5-8cca-4ea730ad3816 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54" status: 404 len: 111 microversion: 2.1 time: 0.029060 Jun 04 18:39:41.179161 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 434/884] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:41 2022] GET /compute/v2.1/servers/1205f37f-ca68-4d25-83e9-ad88c6f52c54 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 18:39:42.313556 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:42.314054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:42.315044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2023587079", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-5573208", "security_groups": [{"name": "tempest-secgroup-smoke-239984416"}], "networks": [{"uuid": "37539cb7-aa0d-40b8-93de-4b46bc4d476f"}], "block_device_mapping_v2": [{"uuid": "2b537a7e-ec54-490e-bbbe-7ba285bc6e50", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:39:42.321032 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:42.321484 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:42.322288 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:42.322722 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:42.336397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 HTTP/1.1 Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:39:42.337959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.339291 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31'} Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:39:42.340170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.341465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.342959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:39:42.342959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-935fe944-7562-4216-87c9-704f0ddc6006 tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 404 len: 111 microversion: 2.1 time: 0.029716 Jun 04 18:39:42.342959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 451/885] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:39:42 2022] DELETE /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:39:42.347553 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:42.348178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] [instance: a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:42.354244 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:42.354685 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:42.355441 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:42.355873 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:42.369418 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] HTTP exception thrown: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Request method failure captured: Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 HTTP/1.1 Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6TQ8yxMcRf-V38Ux1r8b9mvrEVAT4hAEf70GOALkq2pIrmGFQcIROm9pMm2oM2Cg-257NAR26LBGEYP-pzFtETXv2__VK693pxFmyPj18R0x0y580kTRdjEyZus6QcWkI5JLxOImkGzrFzHZEZ4ep3_r29FcZiRxjvNnwi6azJyJNY Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:39:42.370926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71dff5ee406141ec8e0d4a9b58106610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71dff5ee406141ec8e0d4a9b58106610"}]}] Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 71dff5ee406141ec8e0d4a9b58106610 Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955968225 Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 5b5a9f5cdfa6494d97617d68880d5552 Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-1955968225-project Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.372767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31'} Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:39:42.373839 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. Jun 04 18:39:42.375211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:39:42.376957 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] Returning 404 to user: Instance a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:39:42.376957 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-92729d94-6e36-4e2f-9346-46abcfe4272a tempest-AttachVolumeNegativeTest-1955968225 tempest-AttachVolumeNegativeTest-1955968225-project] 10.222.0.39 "GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31" status: 404 len: 111 microversion: 2.1 time: 0.028353 Jun 04 18:39:42.376957 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 452/886] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:42 2022] GET /compute/v2.1/servers/a50dc54c-9dd9-404a-b7f0-4ad2e9ff9d31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:39:42.429743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] validate_networks() for [('37539cb7-aa0d-40b8-93de-4b46bc4d476f', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:39:42.808311 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:39:42.808738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:39:42.809228 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:39:42.809665 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:39:42.810074 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:39:42.819509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:42.819947 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:42.820934 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:42.821450 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:42.838876 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Getting quotas for project b1701547610945ceac41e94e733f61a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:39:42.843403 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Getting quotas for user 308d60778a0e489491cd6b3a79c96385 and project b1701547610945ceac41e94e733f61a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:39:42.904574 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:39:42.906678 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b537a7e-ec54-490e-bbbe-7ba285bc6e50',volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:39:43.046999 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3e423955-07d0-4241-abee-d303cade30db tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.735936 Jun 04 18:39:43.047730 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 435/887] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:39:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:39:43.058747 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a556c8ed-5b41-490f-af0a-0e35cbe0f986 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:43.059363 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a556c8ed-5b41-490f-af0a-0e35cbe0f986 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:43.130497 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a556c8ed-5b41-490f-af0a-0e35cbe0f986 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:43.139697 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a556c8ed-5b41-490f-af0a-0e35cbe0f986 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1086 microversion: 2.1 time: 0.085541 Jun 04 18:39:43.140316 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 453/888] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:43 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1086 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:44.157225 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ff81326-bbbb-4b64-a420-6b5d1b7696bf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:44.157837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6ff81326-bbbb-4b64-a420-6b5d1b7696bf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:44.169525 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ff81326-bbbb-4b64-a420-6b5d1b7696bf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:44.170230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ff81326-bbbb-4b64-a420-6b5d1b7696bf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:44.171218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ff81326-bbbb-4b64-a420-6b5d1b7696bf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:44.176305 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ff81326-bbbb-4b64-a420-6b5d1b7696bf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:44.291454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6ff81326-bbbb-4b64-a420-6b5d1b7696bf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:44.305428 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6ff81326-bbbb-4b64-a420-6b5d1b7696bf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1192 microversion: 2.1 time: 0.147614 Jun 04 18:39:44.305871 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 436/889] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:44 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1192 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:45.322957 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-be205d86-c3a0-4ad7-a302-1e4e35e2ccd3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:45.324269 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-be205d86-c3a0-4ad7-a302-1e4e35e2ccd3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:45.330954 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-be205d86-c3a0-4ad7-a302-1e4e35e2ccd3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:45.331403 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-be205d86-c3a0-4ad7-a302-1e4e35e2ccd3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:45.332819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-be205d86-c3a0-4ad7-a302-1e4e35e2ccd3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:45.333613 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-be205d86-c3a0-4ad7-a302-1e4e35e2ccd3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:45.487664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-be205d86-c3a0-4ad7-a302-1e4e35e2ccd3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:45.495949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-be205d86-c3a0-4ad7-a302-1e4e35e2ccd3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.177280 Jun 04 18:39:45.496528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 454/890] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:45 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:46.514538 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e57a01a3-4f12-402a-8b8b-b9e26ff16066 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:46.515633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e57a01a3-4f12-402a-8b8b-b9e26ff16066 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:46.528384 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e57a01a3-4f12-402a-8b8b-b9e26ff16066 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:46.528959 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e57a01a3-4f12-402a-8b8b-b9e26ff16066 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:46.529856 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e57a01a3-4f12-402a-8b8b-b9e26ff16066 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:46.530503 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e57a01a3-4f12-402a-8b8b-b9e26ff16066 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:46.557111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-5c63acb0-2e93-47a5-a414-6f49fd367c86 req-04eb8e5d-e97d-4b64-aad3-9c718da42f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ab534c-de63-4e2e-84a4-ed1072d868d5", "tag": "35ec7e5f-d6aa-48ed-bcce-e38d546401a3"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:39:46.584997 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-5c63acb0-2e93-47a5-a414-6f49fd367c86 req-04eb8e5d-e97d-4b64-aad3-9c718da42f78 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:46.586516 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-5c63acb0-2e93-47a5-a414-6f49fd367c86 req-04eb8e5d-e97d-4b64-aad3-9c718da42f78 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:46.606610 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-5c63acb0-2e93-47a5-a414-6f49fd367c86 req-04eb8e5d-e97d-4b64-aad3-9c718da42f78 service nova] Creating event network-changed:35ec7e5f-d6aa-48ed-bcce-e38d546401a3 for instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 on hv-cinder-79053 Jun 04 18:39:46.613699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-5c63acb0-2e93-47a5-a414-6f49fd367c86 req-04eb8e5d-e97d-4b64-aad3-9c718da42f78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069881 Jun 04 18:39:46.614490 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 455/891] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:39:46.811806 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e57a01a3-4f12-402a-8b8b-b9e26ff16066 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:46.819793 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e57a01a3-4f12-402a-8b8b-b9e26ff16066 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.310529 Jun 04 18:39:46.820395 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 437/892] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:46 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:47.840994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cd61dd10-ef4b-49b9-800d-2531472f7caf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:47.841693 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cd61dd10-ef4b-49b9-800d-2531472f7caf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:47.849664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd61dd10-ef4b-49b9-800d-2531472f7caf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:47.850108 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd61dd10-ef4b-49b9-800d-2531472f7caf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:47.850905 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd61dd10-ef4b-49b9-800d-2531472f7caf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:47.851319 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd61dd10-ef4b-49b9-800d-2531472f7caf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:48.001923 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cd61dd10-ef4b-49b9-800d-2531472f7caf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:48.012434 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cd61dd10-ef4b-49b9-800d-2531472f7caf tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.179665 Jun 04 18:39:48.013682 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 456/893] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:47 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:49.034177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b2e25ff3-056a-4135-81ce-a97ee591b3a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:49.035124 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b2e25ff3-056a-4135-81ce-a97ee591b3a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:49.043775 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2e25ff3-056a-4135-81ce-a97ee591b3a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:49.044260 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2e25ff3-056a-4135-81ce-a97ee591b3a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:49.045018 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2e25ff3-056a-4135-81ce-a97ee591b3a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:49.045448 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2e25ff3-056a-4135-81ce-a97ee591b3a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:49.197627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b2e25ff3-056a-4135-81ce-a97ee591b3a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:49.205968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b2e25ff3-056a-4135-81ce-a97ee591b3a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.178675 Jun 04 18:39:49.206528 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 438/894] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:49 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:50.225001 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8c2fd886-fc4d-4f6f-b372-b2c63b812803 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:50.225667 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8c2fd886-fc4d-4f6f-b372-b2c63b812803 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:50.232771 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c2fd886-fc4d-4f6f-b372-b2c63b812803 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:50.233224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c2fd886-fc4d-4f6f-b372-b2c63b812803 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:50.233982 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c2fd886-fc4d-4f6f-b372-b2c63b812803 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:50.234416 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c2fd886-fc4d-4f6f-b372-b2c63b812803 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:50.368574 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8c2fd886-fc4d-4f6f-b372-b2c63b812803 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:50.377327 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8c2fd886-fc4d-4f6f-b372-b2c63b812803 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.156320 Jun 04 18:39:50.377953 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 457/895] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:50 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:51.395597 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-652f2f80-1926-4ad5-b89b-f330b29cba73 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:51.396866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-652f2f80-1926-4ad5-b89b-f330b29cba73 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:51.405220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-652f2f80-1926-4ad5-b89b-f330b29cba73 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:51.405668 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-652f2f80-1926-4ad5-b89b-f330b29cba73 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:51.406433 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-652f2f80-1926-4ad5-b89b-f330b29cba73 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:51.406864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-652f2f80-1926-4ad5-b89b-f330b29cba73 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:51.547042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-652f2f80-1926-4ad5-b89b-f330b29cba73 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:51.554550 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-652f2f80-1926-4ad5-b89b-f330b29cba73 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.163117 Jun 04 18:39:51.555312 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 439/896] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:51 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:52.572258 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c26a9822-e9c4-4921-9823-28e78fcbdca5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:52.572879 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c26a9822-e9c4-4921-9823-28e78fcbdca5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:52.580610 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c26a9822-e9c4-4921-9823-28e78fcbdca5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:52.581354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c26a9822-e9c4-4921-9823-28e78fcbdca5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:52.582152 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c26a9822-e9c4-4921-9823-28e78fcbdca5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:52.582588 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c26a9822-e9c4-4921-9823-28e78fcbdca5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:52.720187 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c26a9822-e9c4-4921-9823-28e78fcbdca5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:52.728662 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c26a9822-e9c4-4921-9823-28e78fcbdca5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.160784 Jun 04 18:39:52.729330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 458/897] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:52 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:53.747277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1d313e2e-81a1-4bc1-b942-ea9e62792eee tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:53.747915 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1d313e2e-81a1-4bc1-b942-ea9e62792eee tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:53.751980 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:53.752660 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:53.757288 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1d313e2e-81a1-4bc1-b942-ea9e62792eee tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:53.757774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1d313e2e-81a1-4bc1-b942-ea9e62792eee tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:53.758554 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1d313e2e-81a1-4bc1-b942-ea9e62792eee tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:53.758995 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1d313e2e-81a1-4bc1-b942-ea9e62792eee tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:53.893433 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1d313e2e-81a1-4bc1-b942-ea9e62792eee tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:53.900814 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1d313e2e-81a1-4bc1-b942-ea9e62792eee tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.157978 Jun 04 18:39:53.901369 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 440/898] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:53 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:54.918652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ef3b5375-cf91-4bb8-9076-9bb1774dede7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:54.919466 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ef3b5375-cf91-4bb8-9076-9bb1774dede7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:54.921810 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:54.928415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef3b5375-cf91-4bb8-9076-9bb1774dede7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:54.928863 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef3b5375-cf91-4bb8-9076-9bb1774dede7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:54.929620 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef3b5375-cf91-4bb8-9076-9bb1774dede7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:54.930071 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef3b5375-cf91-4bb8-9076-9bb1774dede7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:55.069847 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ef3b5375-cf91-4bb8-9076-9bb1774dede7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:55.077947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ef3b5375-cf91-4bb8-9076-9bb1774dede7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.163841 Jun 04 18:39:55.078518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 459/899] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:54 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:56.095397 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-412f00e9-98fd-4376-836e-93b1fed4bea0 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:56.095992 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-412f00e9-98fd-4376-836e-93b1fed4bea0 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:56.102931 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-412f00e9-98fd-4376-836e-93b1fed4bea0 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:56.103376 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-412f00e9-98fd-4376-836e-93b1fed4bea0 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:56.104202 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-412f00e9-98fd-4376-836e-93b1fed4bea0 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:56.104851 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-412f00e9-98fd-4376-836e-93b1fed4bea0 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:56.249484 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-412f00e9-98fd-4376-836e-93b1fed4bea0 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:56.257217 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-412f00e9-98fd-4376-836e-93b1fed4bea0 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.166370 Jun 04 18:39:56.257809 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 441/900] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:56 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:57.275702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ef1f107d-c911-4ad5-9cb2-18c0034fa7f3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:57.276618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ef1f107d-c911-4ad5-9cb2-18c0034fa7f3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:57.283707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef1f107d-c911-4ad5-9cb2-18c0034fa7f3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:57.285098 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef1f107d-c911-4ad5-9cb2-18c0034fa7f3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:57.285918 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef1f107d-c911-4ad5-9cb2-18c0034fa7f3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:57.286782 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef1f107d-c911-4ad5-9cb2-18c0034fa7f3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:57.384038 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-70e378cc-1b46-47e6-8baf-fed7708c5d21 req-e96cf2fd-6095-4b99-a74b-bbb0eaa48282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ab534c-de63-4e2e-84a4-ed1072d868d5", "name": "network-vif-plugged", "status": "completed", "tag": "35ec7e5f-d6aa-48ed-bcce-e38d546401a3"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:39:57.396414 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-70e378cc-1b46-47e6-8baf-fed7708c5d21 req-e96cf2fd-6095-4b99-a74b-bbb0eaa48282 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:57.397386 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-70e378cc-1b46-47e6-8baf-fed7708c5d21 req-e96cf2fd-6095-4b99-a74b-bbb0eaa48282 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:57.412990 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-70e378cc-1b46-47e6-8baf-fed7708c5d21 req-e96cf2fd-6095-4b99-a74b-bbb0eaa48282 service nova] Creating event network-vif-plugged:35ec7e5f-d6aa-48ed-bcce-e38d546401a3 for instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 on hv-cinder-79053 Jun 04 18:39:57.419118 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-70e378cc-1b46-47e6-8baf-fed7708c5d21 req-e96cf2fd-6095-4b99-a74b-bbb0eaa48282 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043765 Jun 04 18:39:57.419772 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 442/901] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:39:57.453636 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ef1f107d-c911-4ad5-9cb2-18c0034fa7f3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:57.469554 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ef1f107d-c911-4ad5-9cb2-18c0034fa7f3 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.198631 Jun 04 18:39:57.470138 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 460/902] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:57 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:58.494850 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8f3f6f6a-0b56-4464-8a69-22f105ff6bcd tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:58.496127 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8f3f6f6a-0b56-4464-8a69-22f105ff6bcd tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:58.503998 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8f3f6f6a-0b56-4464-8a69-22f105ff6bcd tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:58.504484 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8f3f6f6a-0b56-4464-8a69-22f105ff6bcd tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:58.505347 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8f3f6f6a-0b56-4464-8a69-22f105ff6bcd tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:58.505840 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8f3f6f6a-0b56-4464-8a69-22f105ff6bcd tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:58.654994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8f3f6f6a-0b56-4464-8a69-22f105ff6bcd tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:58.663111 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8f3f6f6a-0b56-4464-8a69-22f105ff6bcd tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1257 microversion: 2.1 time: 0.179000 Jun 04 18:39:58.663675 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 443/903] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:58 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1257 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:59.684165 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-041ea4a6-c5cc-4a2a-a357-66d7e6bbb096 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:59.685133 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-041ea4a6-c5cc-4a2a-a357-66d7e6bbb096 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:59.696071 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-041ea4a6-c5cc-4a2a-a357-66d7e6bbb096 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:59.696834 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-041ea4a6-c5cc-4a2a-a357-66d7e6bbb096 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:59.698088 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-041ea4a6-c5cc-4a2a-a357-66d7e6bbb096 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:59.698809 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-041ea4a6-c5cc-4a2a-a357-66d7e6bbb096 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:59.843994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-041ea4a6-c5cc-4a2a-a357-66d7e6bbb096 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:39:59.851956 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-041ea4a6-c5cc-4a2a-a357-66d7e6bbb096 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1441 microversion: 2.1 time: 0.174324 Jun 04 18:39:59.852557 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 461/904] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:59 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1441 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:39:59.868187 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-59d085a0-a84c-47f3-87d8-a03376e54564 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:39:59.868753 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-59d085a0-a84c-47f3-87d8-a03376e54564 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:39:59.875638 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-59d085a0-a84c-47f3-87d8-a03376e54564 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:59.876126 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-59d085a0-a84c-47f3-87d8-a03376e54564 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:39:59.876890 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-59d085a0-a84c-47f3-87d8-a03376e54564 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:39:59.877324 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-59d085a0-a84c-47f3-87d8-a03376e54564 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:00.016898 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-59d085a0-a84c-47f3-87d8-a03376e54564 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:00.024731 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-59d085a0-a84c-47f3-87d8-a03376e54564 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1441 microversion: 2.1 time: 0.160403 Jun 04 18:40:00.025256 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 444/905] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:39:59 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1441 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:02.090265 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-be65da64-dda9-492e-8f45-99dcb778f5aa req-745d7ba8-6e26-49aa-9f55-4b66391006f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ab534c-de63-4e2e-84a4-ed1072d868d5", "tag": "35ec7e5f-d6aa-48ed-bcce-e38d546401a3"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:02.094386 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:02.099791 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-be65da64-dda9-492e-8f45-99dcb778f5aa req-745d7ba8-6e26-49aa-9f55-4b66391006f8 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:02.100487 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-be65da64-dda9-492e-8f45-99dcb778f5aa req-745d7ba8-6e26-49aa-9f55-4b66391006f8 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:02.114022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-be65da64-dda9-492e-8f45-99dcb778f5aa req-745d7ba8-6e26-49aa-9f55-4b66391006f8 service nova] Creating event network-changed:35ec7e5f-d6aa-48ed-bcce-e38d546401a3 for instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 on hv-cinder-79053 Jun 04 18:40:02.120645 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-be65da64-dda9-492e-8f45-99dcb778f5aa req-745d7ba8-6e26-49aa-9f55-4b66391006f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033939 Jun 04 18:40:02.121253 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 462/906] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:40:19.553435 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:19.555200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:19.563771 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6975800a-0101-458b-9846-d797307736a8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:19.564902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6975800a-0101-458b-9846-d797307736a8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:19.574200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6975800a-0101-458b-9846-d797307736a8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:19.574548 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6975800a-0101-458b-9846-d797307736a8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:19.575405 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6975800a-0101-458b-9846-d797307736a8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:19.575987 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6975800a-0101-458b-9846-d797307736a8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:19.610253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6975800a-0101-458b-9846-d797307736a8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments/18643a0f-49a4-4a99-848b-d2470183000e" status: 200 len: 194 microversion: 2.20 time: 0.059270 Jun 04 18:40:19.610827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 445/907] 10.222.0.39 () {60 vars in 1453 bytes} [Sat Jun 4 18:40:19 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments/18643a0f-49a4-4a99-848b-d2470183000e => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:40:19.678488 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=57 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:19.683579 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8b59a998-2f01-4c14-81dd-6daee8c0653d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:19.684179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8b59a998-2f01-4c14-81dd-6daee8c0653d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:19.690971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b59a998-2f01-4c14-81dd-6daee8c0653d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:19.691425 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b59a998-2f01-4c14-81dd-6daee8c0653d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:19.692369 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b59a998-2f01-4c14-81dd-6daee8c0653d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:19.692680 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b59a998-2f01-4c14-81dd-6daee8c0653d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:19.781745 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-8b59a998-2f01-4c14-81dd-6daee8c0653d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lazy-loading 'services' on Instance uuid ba7020d7-a1c8-41d2-8172-08a5c8438167 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:40:19.862586 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8b59a998-2f01-4c14-81dd-6daee8c0653d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments/18643a0f-49a4-4a99-848b-d2470183000e" status: 202 len: 0 microversion: 2.20 time: 0.185756 Jun 04 18:40:19.863221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 463/908] 10.222.0.39 () {60 vars in 1456 bytes} [Sat Jun 4 18:40:19 2022] DELETE /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments/18643a0f-49a4-4a99-848b-d2470183000e => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:40:19.871765 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d36a478f-4699-4490-9234-fb702dc162c9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:19.872738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d36a478f-4699-4490-9234-fb702dc162c9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:19.879385 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d36a478f-4699-4490-9234-fb702dc162c9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:19.879838 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d36a478f-4699-4490-9234-fb702dc162c9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:19.880919 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d36a478f-4699-4490-9234-fb702dc162c9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:19.881390 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d36a478f-4699-4490-9234-fb702dc162c9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:19.918109 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d36a478f-4699-4490-9234-fb702dc162c9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050366 Jun 04 18:40:19.918663 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 446/909] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 4 18:40:19 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 18:40:20.930868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-79c1a445-67ba-44a3-897c-78cdf7e23c92 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:20.932109 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-79c1a445-67ba-44a3-897c-78cdf7e23c92 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:20.939285 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-79c1a445-67ba-44a3-897c-78cdf7e23c92 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:20.939992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-79c1a445-67ba-44a3-897c-78cdf7e23c92 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:20.940838 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-79c1a445-67ba-44a3-897c-78cdf7e23c92 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:20.941258 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-79c1a445-67ba-44a3-897c-78cdf7e23c92 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:20.972883 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-79c1a445-67ba-44a3-897c-78cdf7e23c92 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047331 Jun 04 18:40:20.973481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 464/910] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 4 18:40:20 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:40:21.989384 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f7549296-ef6f-41e8-8565-72a667e44faa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:21.990522 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f7549296-ef6f-41e8-8565-72a667e44faa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:21.997821 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f7549296-ef6f-41e8-8565-72a667e44faa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:21.998310 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f7549296-ef6f-41e8-8565-72a667e44faa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:21.999146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f7549296-ef6f-41e8-8565-72a667e44faa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:21.999609 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f7549296-ef6f-41e8-8565-72a667e44faa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:22.032540 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f7549296-ef6f-41e8-8565-72a667e44faa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049914 Jun 04 18:40:22.033083 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 447/911] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 4 18:40:21 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:40:23.048393 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-338309b6-34f4-4498-b369-08c41a39197a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:23.049886 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-338309b6-34f4-4498-b369-08c41a39197a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:23.060389 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-338309b6-34f4-4498-b369-08c41a39197a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:23.061371 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-338309b6-34f4-4498-b369-08c41a39197a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:23.062696 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-338309b6-34f4-4498-b369-08c41a39197a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:23.063426 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-338309b6-34f4-4498-b369-08c41a39197a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:23.096563 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-338309b6-34f4-4498-b369-08c41a39197a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054858 Jun 04 18:40:23.097124 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 465/912] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 4 18:40:23 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:40:24.112863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a6320ad3-0471-484c-a8a4-b2f9dd60343f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:24.114749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a6320ad3-0471-484c-a8a4-b2f9dd60343f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:24.122411 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6320ad3-0471-484c-a8a4-b2f9dd60343f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:24.122877 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6320ad3-0471-484c-a8a4-b2f9dd60343f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:24.123664 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6320ad3-0471-484c-a8a4-b2f9dd60343f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:24.124159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6320ad3-0471-484c-a8a4-b2f9dd60343f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:24.161150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a6320ad3-0471-484c-a8a4-b2f9dd60343f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054765 Jun 04 18:40:24.161794 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 448/913] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 4 18:40:24 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:40:25.181304 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6b578ab5-775c-4538-97fd-f1ca0899a6fa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:25.182234 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6b578ab5-775c-4538-97fd-f1ca0899a6fa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:25.189266 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b578ab5-775c-4538-97fd-f1ca0899a6fa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:25.189732 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b578ab5-775c-4538-97fd-f1ca0899a6fa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:25.190483 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b578ab5-775c-4538-97fd-f1ca0899a6fa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:25.190912 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b578ab5-775c-4538-97fd-f1ca0899a6fa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:25.224887 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6b578ab5-775c-4538-97fd-f1ca0899a6fa tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047689 Jun 04 18:40:25.225441 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 466/914] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 4 18:40:25 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 18:40:26.237839 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ed3906a4-a834-457a-8cba-267c444d0e84 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:26.238771 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ed3906a4-a834-457a-8cba-267c444d0e84 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:26.245621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed3906a4-a834-457a-8cba-267c444d0e84 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:26.246081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed3906a4-a834-457a-8cba-267c444d0e84 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:26.246857 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed3906a4-a834-457a-8cba-267c444d0e84 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:26.247296 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed3906a4-a834-457a-8cba-267c444d0e84 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:26.277218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ed3906a4-a834-457a-8cba-267c444d0e84 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043359 Jun 04 18:40:26.277733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 449/915] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 4 18:40:26 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:40:27.289275 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c5bebafb-34d5-4b72-ae33-e40fe90f8ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:27.290195 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c5bebafb-34d5-4b72-ae33-e40fe90f8ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:27.297274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c5bebafb-34d5-4b72-ae33-e40fe90f8ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:27.297707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c5bebafb-34d5-4b72-ae33-e40fe90f8ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:27.298469 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c5bebafb-34d5-4b72-ae33-e40fe90f8ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:27.298920 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c5bebafb-34d5-4b72-ae33-e40fe90f8ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:27.329153 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c5bebafb-34d5-4b72-ae33-e40fe90f8ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043838 Jun 04 18:40:27.329717 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 467/916] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 4 18:40:27 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:27.392963 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-eb109416-6d0e-4fd5-a5b1-509ce60e03c3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:27.393504 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-eb109416-6d0e-4fd5-a5b1-509ce60e03c3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:27.400173 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eb109416-6d0e-4fd5-a5b1-509ce60e03c3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:27.400628 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eb109416-6d0e-4fd5-a5b1-509ce60e03c3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:27.401420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eb109416-6d0e-4fd5-a5b1-509ce60e03c3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:27.401858 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eb109416-6d0e-4fd5-a5b1-509ce60e03c3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:27.427537 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-eb109416-6d0e-4fd5-a5b1-509ce60e03c3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:40:27.511988 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-eb109416-6d0e-4fd5-a5b1-509ce60e03c3 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 204 len: 0 microversion: 2.20 time: 0.122648 Jun 04 18:40:27.512551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 450/917] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 4 18:40:27 2022] DELETE /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 18:40:27.521479 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:27.522056 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:27.529154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:27.529638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:27.530404 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:27.530841 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:27.678733 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:27.691428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:27.693778 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:27.695649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ab327564-0360-45d7-87b1-794837ab2799 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.177869 Jun 04 18:40:27.696484 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 468/918] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:27 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:28.719092 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:28.720061 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:28.728943 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:28.729547 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:28.731084 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:28.731526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:28.871761 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:28.884420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:28.886642 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:28.887803 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1eee1d45-5839-48c3-add8-889af185a0ed tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.175081 Jun 04 18:40:28.888387 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 451/919] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:28 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:29.510926 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-769395340", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-493393868", "security_groups": [{"name": "tempest-secgroup-smoke-1787165407"}], "block_device_mapping_v2": [{"uuid": "0f436b54-1b56-4e7f-b621-88271029a805", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9fe7d892-020a-4605-a021-7aea70be8ad6"}]}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:29.647854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] validate_networks() for [('9fe7d892-020a-4605-a021-7aea70be8ad6', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:40:29.908143 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:29.914313 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:29.921586 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:29.922136 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:29.922794 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:29.923235 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:30.059326 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:40:30.059915 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:40:30.060504 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:40:30.060954 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:40:30.061364 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:40:30.071719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:30.072199 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:30.073003 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:30.073441 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:30.091486 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Getting quotas for project 2829dcddd2864698b273038b8df5ce76. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:40:30.095764 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Getting quotas for user cf94c76ba04b403b91a7ff77a2f476e8 and project 2829dcddd2864698b273038b8df5ce76. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:40:30.153251 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:40:30.155803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f436b54-1b56-4e7f-b621-88271029a805',volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:40:30.173057 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:30.181664 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:30.183268 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:30.184894 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0d9b163a-0a10-46cb-a1f9-a81c4575bb0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 200 len: 1723 microversion: 2.20 time: 0.281923 Jun 04 18:40:30.185287 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 452/920] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:29 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:30.294393 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [2ef70cc4-2411-41ed-9a03-3ad62e0d0be6] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 18:40:30.633086 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-3b0e4a11-a88b-45f3-94c8-280e9a01a008 req-a9a320b6-fc23-4ad6-a565-6ea4f0f8dd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7020d7-a1c8-41d2-8172-08a5c8438167", "name": "network-vif-deleted", "tag": "c0785036-2e03-4588-a648-bccd3d33560a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:30.641784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-3b0e4a11-a88b-45f3-94c8-280e9a01a008 req-a9a320b6-fc23-4ad6-a565-6ea4f0f8dd31 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:30.642522 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-3b0e4a11-a88b-45f3-94c8-280e9a01a008 req-a9a320b6-fc23-4ad6-a565-6ea4f0f8dd31 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:30.656737 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-3b0e4a11-a88b-45f3-94c8-280e9a01a008 req-a9a320b6-fc23-4ad6-a565-6ea4f0f8dd31 service nova] Creating event network-vif-deleted:c0785036-2e03-4588-a648-bccd3d33560a for instance ba7020d7-a1c8-41d2-8172-08a5c8438167 on hv-cinder-79053 Jun 04 18:40:30.663434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-3b0e4a11-a88b-45f3-94c8-280e9a01a008 req-a9a320b6-fc23-4ad6-a565-6ea4f0f8dd31 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033970 Jun 04 18:40:30.664918 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 453/921] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:40:31.204328 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:31.205208 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:31.211662 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:31.212179 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:31.212945 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:31.213380 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:31.227210 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] HTTP exception thrown: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Request method failure captured: Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 HTTP/1.1 Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6Y3mySA38CSk9uFqcSfPF-ofZE-pkMVA3bGNig9VhbQYdLTelikv97Y64UQS4rxUC-f_Xqkv7dk8g4DWjhEhucJtsP2BtQ4QU5cnU95crj74Xr7afOOaXST74iJMPTYUzFt_5yGB9-POOuXMomhDK9_5VpnIPZcO8YwnWXE7JlCQ98 Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:40:31.229044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}] Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 6ceccf3f6ce044b98503b09b13cd2510 Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:40:31.230860 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'ba7020d7-a1c8-41d2-8172-08a5c8438167'} Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:40:31.235636 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:40:31.237255 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:40:31.238676 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Returning 404 to user: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:40:31.238676 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-de797820-a4d5-49e1-a420-70e84e400fc8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 404 len: 111 microversion: 2.20 time: 0.031152 Jun 04 18:40:31.238676 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 454/922] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:31 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:40:31.239400 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-93d3b057-b097-40ee-b3e9-1b498c434464 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '.version_select at 0x7f467df9b0d0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:31.262972 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-93d3b057-b097-40ee-b3e9-1b498c434464 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187799531" status: 204 len: 0 microversion: 2.20 time: 0.027251 Jun 04 18:40:31.263583 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 455/923] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 4 18:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187799531 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 18:40:31.306916 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [2ef70cc4-2411-41ed-9a03-3ad62e0d0be6] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47070. Jun 04 18:40:31.312037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4e4b971a-6c5b-453c-b5ac-8bbccc6f4bfe tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.805064 Jun 04 18:40:31.317523 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 469/924] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:40:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:40:31.322823 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ef16bec4-8f6f-44c6-a3ab-608c34e3110b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:31.323797 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ef16bec4-8f6f-44c6-a3ab-608c34e3110b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:31.434329 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ef16bec4-8f6f-44c6-a3ab-608c34e3110b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:31.445461 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ef16bec4-8f6f-44c6-a3ab-608c34e3110b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1093 microversion: 2.1 time: 0.126342 Jun 04 18:40:31.446732 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 456/925] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:31 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1093 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:31.979488 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d91a6cb3-f82a-46fe-82e4-8fb24261afcd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'create', calling method: .version_select at 0x7f467e660670>, body: {"keypair": {"name": "tempest-keypair-815953202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKf/hK4SAGh7MYF0v564uxVN9i3yTkCzwp+T4IdNNIE00VFYYQZPFeHT7aArMcWgtV3G3Q0aOOq/aXG7eZsTmmZmXJgRDhl+VJtIjj1IuIfS8jIx2hs6JjRLnhIEO2tMg=="}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:31.994974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-d91a6cb3-f82a-46fe-82e4-8fb24261afcd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Getting quotas for project 1c1a5168618d4511a41baa4f25425b86. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:40:31.999453 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-d91a6cb3-f82a-46fe-82e4-8fb24261afcd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Getting quotas for user 6ceccf3f6ce044b98503b09b13cd2510 and project 1c1a5168618d4511a41baa4f25425b86. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:40:32.023578 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d91a6cb3-f82a-46fe-82e4-8fb24261afcd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048561 Jun 04 18:40:32.029951 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 470/926] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 4 18:40:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 04 18:40:32.464835 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e0669cca-1605-4c8f-ae84-0c51db47716b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:32.466618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e0669cca-1605-4c8f-ae84-0c51db47716b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:32.475570 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0669cca-1605-4c8f-ae84-0c51db47716b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:32.476479 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0669cca-1605-4c8f-ae84-0c51db47716b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:32.477332 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0669cca-1605-4c8f-ae84-0c51db47716b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:32.477784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0669cca-1605-4c8f-ae84-0c51db47716b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:32.582737 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e0669cca-1605-4c8f-ae84-0c51db47716b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:32.590631 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e0669cca-1605-4c8f-ae84-0c51db47716b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1209 microversion: 2.1 time: 0.131638 Jun 04 18:40:32.591527 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 457/927] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:32 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1209 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:33.432945 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1087976542", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "660a1442-fc81-45f2-ab4a-74a7caf0e179"}], "security_groups": [{"name": "tempest-securitygroup--390198052"}], "key_name": "tempest-keypair-815953202", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:33.541755 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] validate_networks() for [('660a1442-fc81-45f2-ab4a-74a7caf0e179', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:40:33.608498 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b2c85df0-f6f1-472b-9d43-0733cb85211c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:33.609127 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b2c85df0-f6f1-472b-9d43-0733cb85211c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:33.615556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2c85df0-f6f1-472b-9d43-0733cb85211c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:33.616137 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2c85df0-f6f1-472b-9d43-0733cb85211c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:33.617152 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2c85df0-f6f1-472b-9d43-0733cb85211c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:33.617573 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2c85df0-f6f1-472b-9d43-0733cb85211c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:33.713396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b2c85df0-f6f1-472b-9d43-0733cb85211c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:33.721560 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b2c85df0-f6f1-472b-9d43-0733cb85211c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1209 microversion: 2.1 time: 0.117110 Jun 04 18:40:33.722383 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 458/928] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:33 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:40:33.918433 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:40:33.918923 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:40:33.919399 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:40:33.919840 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:40:33.920335 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:40:33.929402 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:33.929856 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:33.930649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:33.931082 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:33.947776 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Getting quotas for project 1c1a5168618d4511a41baa4f25425b86. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:40:33.951903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Getting quotas for user 6ceccf3f6ce044b98503b09b13cd2510 and project 1c1a5168618d4511a41baa4f25425b86. Resources: {'ram', 'instances', 'cores'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:40:33.963602 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:40:33.965924 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:40:34.018449 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0c145523-0a42-416f-b797-ef81bfe3fba4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.590447 Jun 04 18:40:34.019421 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 471/929] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 4 18:40:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 18:40:34.030034 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5686e3a4-327e-417c-b88f-c70220af4464 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:34.030991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5686e3a4-327e-417c-b88f-c70220af4464 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:34.291610 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5686e3a4-327e-417c-b88f-c70220af4464 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:34.314465 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5686e3a4-327e-417c-b88f-c70220af4464 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:34.316154 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5686e3a4-327e-417c-b88f-c70220af4464 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:34.317551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5686e3a4-327e-417c-b88f-c70220af4464 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1281 microversion: 2.20 time: 0.291709 Jun 04 18:40:34.318911 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 459/930] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:34 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1281 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:34.738868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8ce4c728-849c-46ad-9d97-ce580c0cabef tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:34.739473 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8ce4c728-849c-46ad-9d97-ce580c0cabef tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:34.746144 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ce4c728-849c-46ad-9d97-ce580c0cabef tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:34.746585 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ce4c728-849c-46ad-9d97-ce580c0cabef tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:34.747429 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ce4c728-849c-46ad-9d97-ce580c0cabef tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:34.747859 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ce4c728-849c-46ad-9d97-ce580c0cabef tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:34.885038 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8ce4c728-849c-46ad-9d97-ce580c0cabef tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:34.893125 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8ce4c728-849c-46ad-9d97-ce580c0cabef tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1277 microversion: 2.1 time: 0.158711 Jun 04 18:40:34.893716 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 472/931] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:34 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:35.183661 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-65597223-2251-4bcd-aa1b-386d6c93a335 req-b3e486d1-b2dc-41d6-86f2-cb0603d6ac00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d75266f-49ff-434a-aedf-33ee2c9aa1f6", "tag": "aaff41ef-ea9c-4fbb-aca7-6e83376b98f6"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:35.196034 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-65597223-2251-4bcd-aa1b-386d6c93a335 req-b3e486d1-b2dc-41d6-86f2-cb0603d6ac00 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:35.196925 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-65597223-2251-4bcd-aa1b-386d6c93a335 req-b3e486d1-b2dc-41d6-86f2-cb0603d6ac00 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:35.212140 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-65597223-2251-4bcd-aa1b-386d6c93a335 req-b3e486d1-b2dc-41d6-86f2-cb0603d6ac00 service nova] Creating event network-changed:aaff41ef-ea9c-4fbb-aca7-6e83376b98f6 for instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 on hv-cinder-79053 Jun 04 18:40:35.217666 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-65597223-2251-4bcd-aa1b-386d6c93a335 req-b3e486d1-b2dc-41d6-86f2-cb0603d6ac00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037596 Jun 04 18:40:35.218266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 460/932] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:40:35.337763 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:35.338483 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:35.345906 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:35.346337 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:35.347125 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:35.347573 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:35.413869 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:35.422310 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:35.423944 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:35.425181 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0269e6ba-1fd7-4749-accc-01ccaed237b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1285 microversion: 2.20 time: 0.091541 Jun 04 18:40:35.425826 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 473/933] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:35 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:35.916085 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-760a1cb4-5397-4a2d-8c51-1bfed83bd774 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:35.917286 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-760a1cb4-5397-4a2d-8c51-1bfed83bd774 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:35.925743 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-760a1cb4-5397-4a2d-8c51-1bfed83bd774 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:35.926192 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-760a1cb4-5397-4a2d-8c51-1bfed83bd774 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:35.927018 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-760a1cb4-5397-4a2d-8c51-1bfed83bd774 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:35.927451 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-760a1cb4-5397-4a2d-8c51-1bfed83bd774 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:36.066285 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-760a1cb4-5397-4a2d-8c51-1bfed83bd774 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:36.078472 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-760a1cb4-5397-4a2d-8c51-1bfed83bd774 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1277 microversion: 2.1 time: 0.169611 Jun 04 18:40:36.079277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 461/934] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:35 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:36.446879 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:36.447853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:36.456555 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:36.457007 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:36.457783 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:36.458219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:36.523702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:36.537274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:36.539610 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:36.541467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-58dc2d5e-d180-4a57-bf5b-85cdd0a0e424 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1277 microversion: 2.20 time: 0.100495 Jun 04 18:40:36.542218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 474/935] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:36 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:37.104530 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8985278e-e600-425d-a181-7edc02b01979 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:37.105356 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8985278e-e600-425d-a181-7edc02b01979 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:37.113218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8985278e-e600-425d-a181-7edc02b01979 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:37.113630 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8985278e-e600-425d-a181-7edc02b01979 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:37.114395 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8985278e-e600-425d-a181-7edc02b01979 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:37.114827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8985278e-e600-425d-a181-7edc02b01979 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:37.358936 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8985278e-e600-425d-a181-7edc02b01979 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:37.370956 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8985278e-e600-425d-a181-7edc02b01979 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1277 microversion: 2.1 time: 0.271988 Jun 04 18:40:37.371985 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 462/936] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:37 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:37.564755 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:37.565534 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:37.577131 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:37.577727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:37.578751 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:37.579472 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:37.686224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:37.697665 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:37.699340 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:37.700548 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9c8a5d08-500a-4823-a793-4507835d19af tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1339 microversion: 2.20 time: 0.142628 Jun 04 18:40:37.701125 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 475/937] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:37 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:38.394944 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-10e867ff-f7c6-48b7-bc0e-7dba6384f2d9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:38.396068 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-10e867ff-f7c6-48b7-bc0e-7dba6384f2d9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:38.406389 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10e867ff-f7c6-48b7-bc0e-7dba6384f2d9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:38.406389 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10e867ff-f7c6-48b7-bc0e-7dba6384f2d9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:38.407102 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10e867ff-f7c6-48b7-bc0e-7dba6384f2d9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:38.407578 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10e867ff-f7c6-48b7-bc0e-7dba6384f2d9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:38.546993 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10e867ff-f7c6-48b7-bc0e-7dba6384f2d9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:38.554769 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-10e867ff-f7c6-48b7-bc0e-7dba6384f2d9 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.167952 Jun 04 18:40:38.555393 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 463/938] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:38 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:38.719221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:38.719985 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:38.726466 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:38.726918 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:38.727706 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:38.728214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:38.868311 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:38.876441 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:38.877943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:38.879054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9775b6e5-e01f-4223-b6f5-113c50238baf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.164430 Jun 04 18:40:38.879620 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 476/939] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:38 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:39.573587 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-398e77bc-6e71-4511-9c2f-9592c1184177 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:39.574136 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-398e77bc-6e71-4511-9c2f-9592c1184177 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:39.581742 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-398e77bc-6e71-4511-9c2f-9592c1184177 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:39.582199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-398e77bc-6e71-4511-9c2f-9592c1184177 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:39.582975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-398e77bc-6e71-4511-9c2f-9592c1184177 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:39.583598 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-398e77bc-6e71-4511-9c2f-9592c1184177 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:39.729273 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-398e77bc-6e71-4511-9c2f-9592c1184177 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:39.735790 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:39.738460 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-398e77bc-6e71-4511-9c2f-9592c1184177 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.169379 Jun 04 18:40:39.739813 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 464/940] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:39 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:39.827594 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-8621a482-7107-4752-b6b7-ededffe92717 req-888cbe38-17b7-49f5-ba1f-90ba3d1f4f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02795c57-88a4-46ac-be72-8c43dc178e4f", "tag": "0e876440-c9c1-4ed0-be90-0af7d5fd38fe"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:39.836903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-8621a482-7107-4752-b6b7-ededffe92717 req-888cbe38-17b7-49f5-ba1f-90ba3d1f4f7d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:39.837345 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-8621a482-7107-4752-b6b7-ededffe92717 req-888cbe38-17b7-49f5-ba1f-90ba3d1f4f7d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:39.849563 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-8621a482-7107-4752-b6b7-ededffe92717 req-888cbe38-17b7-49f5-ba1f-90ba3d1f4f7d service nova] Creating event network-changed:0e876440-c9c1-4ed0-be90-0af7d5fd38fe for instance 02795c57-88a4-46ac-be72-8c43dc178e4f on hv-cinder-79053 Jun 04 18:40:39.854751 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-8621a482-7107-4752-b6b7-ededffe92717 req-888cbe38-17b7-49f5-ba1f-90ba3d1f4f7d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191050 Jun 04 18:40:39.855521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 477/941] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:40:39.897917 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:39.898543 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:39.908557 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:39.909594 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:39.910704 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:39.911333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:40.061495 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:40.069807 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:40.071674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:40.072965 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bb232e1f-7c5d-4ae6-9907-03a2fcd84830 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.179156 Jun 04 18:40:40.073601 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 465/942] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:39 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:40.760392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-84423d87-a3dd-455d-b62b-cfce9521128a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:40.761312 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-84423d87-a3dd-455d-b62b-cfce9521128a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:40.771800 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84423d87-a3dd-455d-b62b-cfce9521128a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:40.772536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84423d87-a3dd-455d-b62b-cfce9521128a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:40.773707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84423d87-a3dd-455d-b62b-cfce9521128a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:40.774372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84423d87-a3dd-455d-b62b-cfce9521128a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:40.928969 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84423d87-a3dd-455d-b62b-cfce9521128a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:40.937132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-84423d87-a3dd-455d-b62b-cfce9521128a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.184164 Jun 04 18:40:40.937981 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 478/943] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:40 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:41.091237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:41.091788 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:41.098633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:41.099204 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:41.100050 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:41.100620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:41.241546 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:41.250040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:41.251553 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:41.252694 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b2b49030-30a0-4af7-bbfd-064b5cd3952a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.165865 Jun 04 18:40:41.253259 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 466/944] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:41 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:41.954707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-75a0cd2d-c0db-4463-a29a-b8a8bef222d6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:41.955280 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-75a0cd2d-c0db-4463-a29a-b8a8bef222d6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:41.962590 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75a0cd2d-c0db-4463-a29a-b8a8bef222d6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:41.963041 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75a0cd2d-c0db-4463-a29a-b8a8bef222d6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:41.963816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75a0cd2d-c0db-4463-a29a-b8a8bef222d6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:41.964285 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75a0cd2d-c0db-4463-a29a-b8a8bef222d6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:42.112044 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-75a0cd2d-c0db-4463-a29a-b8a8bef222d6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:42.119666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-75a0cd2d-c0db-4463-a29a-b8a8bef222d6 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.169158 Jun 04 18:40:42.120270 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 479/945] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:41 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:42.277125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:42.281351 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:42.294079 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:42.294079 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:42.295046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:42.298917 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:42.428901 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:42.437176 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:42.438649 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:42.439747 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-388c448e-b118-4795-adca-ccc9b7b9f496 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.170696 Jun 04 18:40:42.440342 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 467/946] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:42 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:43.136752 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3b0fdef9-1f23-4d96-8d3a-240e854be3cd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:43.137374 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3b0fdef9-1f23-4d96-8d3a-240e854be3cd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:43.144074 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3b0fdef9-1f23-4d96-8d3a-240e854be3cd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:43.144849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3b0fdef9-1f23-4d96-8d3a-240e854be3cd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:43.145846 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3b0fdef9-1f23-4d96-8d3a-240e854be3cd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:43.146727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3b0fdef9-1f23-4d96-8d3a-240e854be3cd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:43.323569 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3b0fdef9-1f23-4d96-8d3a-240e854be3cd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:43.332277 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3b0fdef9-1f23-4d96-8d3a-240e854be3cd tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.199399 Jun 04 18:40:43.333002 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 480/947] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:43 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:43.458105 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:43.458686 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:43.465635 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:43.466145 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:43.466931 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:43.467364 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:43.603344 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:43.611858 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:43.613404 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:43.614526 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-835fd402-ff9f-4234-af07-f07734a7f63c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.160373 Jun 04 18:40:43.615083 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 468/948] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:43 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:44.349547 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-aa59a726-ff2a-45f0-a051-f521c86969b5 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:44.350180 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-aa59a726-ff2a-45f0-a051-f521c86969b5 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:44.352214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=4 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:44.352998 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=16 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:44.359942 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aa59a726-ff2a-45f0-a051-f521c86969b5 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:44.360416 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aa59a726-ff2a-45f0-a051-f521c86969b5 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:44.361191 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aa59a726-ff2a-45f0-a051-f521c86969b5 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:44.361628 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-aa59a726-ff2a-45f0-a051-f521c86969b5 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:44.500828 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-aa59a726-ff2a-45f0-a051-f521c86969b5 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:44.504297 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:44.508782 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-aa59a726-ff2a-45f0-a051-f521c86969b5 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.163215 Jun 04 18:40:44.509336 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 481/949] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:44 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:44.633926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:44.634542 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:44.636479 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=4 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:44.643808 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:44.644714 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:44.645717 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:44.646213 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:44.789617 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:44.798850 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:44.800392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:44.801506 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-294397c9-6a96-44b1-b427-f7917638cbd1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.171557 Jun 04 18:40:44.802075 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 469/950] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:44 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:45.525994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-637ab3f0-d4cb-44a1-b73b-9d0cdd592124 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:45.526762 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-637ab3f0-d4cb-44a1-b73b-9d0cdd592124 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:45.534868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-637ab3f0-d4cb-44a1-b73b-9d0cdd592124 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:45.535329 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-637ab3f0-d4cb-44a1-b73b-9d0cdd592124 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:45.536131 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-637ab3f0-d4cb-44a1-b73b-9d0cdd592124 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:45.536564 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-637ab3f0-d4cb-44a1-b73b-9d0cdd592124 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:45.673915 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-637ab3f0-d4cb-44a1-b73b-9d0cdd592124 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:45.683243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-637ab3f0-d4cb-44a1-b73b-9d0cdd592124 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.161045 Jun 04 18:40:45.684046 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 482/951] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:45 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:45.823149 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:45.823727 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:45.831238 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:45.831695 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:45.832496 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:45.832935 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:45.980982 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:45.989304 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:45.991437 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:45.992880 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b718cbd3-7829-4bd7-83a2-c83e4d5f0274 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.173638 Jun 04 18:40:45.993621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 470/952] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:45 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:46.703552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-348d1dc3-4b19-4c96-88b9-37c252720783 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:46.704213 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-348d1dc3-4b19-4c96-88b9-37c252720783 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:46.714646 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-348d1dc3-4b19-4c96-88b9-37c252720783 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:46.715241 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-348d1dc3-4b19-4c96-88b9-37c252720783 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:46.716602 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-348d1dc3-4b19-4c96-88b9-37c252720783 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:46.717090 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-348d1dc3-4b19-4c96-88b9-37c252720783 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:46.856681 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-348d1dc3-4b19-4c96-88b9-37c252720783 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:46.866432 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-348d1dc3-4b19-4c96-88b9-37c252720783 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.169003 Jun 04 18:40:46.867017 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 483/953] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:46 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:47.013749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:47.014326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:47.022196 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:47.022581 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:47.023431 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:47.023866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:47.169736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:47.178538 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:47.180123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:47.181267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-eaf92a51-4e89-4874-bdce-a5ab5512c98b tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.172050 Jun 04 18:40:47.181833 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 471/954] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:47 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:47.883062 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c6ae4934-84d2-492b-afff-cbef4038ef28 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:47.884018 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c6ae4934-84d2-492b-afff-cbef4038ef28 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:47.903378 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-e4dfd2eb-fa08-4089-b4cc-1fbb98f454ee req-17d314b1-5bfb-46de-bc4e-4e36f46d5281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02795c57-88a4-46ac-be72-8c43dc178e4f", "name": "network-vif-plugged", "status": "completed", "tag": "0e876440-c9c1-4ed0-be90-0af7d5fd38fe"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:47.904326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6ae4934-84d2-492b-afff-cbef4038ef28 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:47.904957 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6ae4934-84d2-492b-afff-cbef4038ef28 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:47.906471 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6ae4934-84d2-492b-afff-cbef4038ef28 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:47.907270 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6ae4934-84d2-492b-afff-cbef4038ef28 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:47.913087 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e4dfd2eb-fa08-4089-b4cc-1fbb98f454ee req-17d314b1-5bfb-46de-bc4e-4e36f46d5281 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:47.913540 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e4dfd2eb-fa08-4089-b4cc-1fbb98f454ee req-17d314b1-5bfb-46de-bc4e-4e36f46d5281 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:47.925119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-e4dfd2eb-fa08-4089-b4cc-1fbb98f454ee req-17d314b1-5bfb-46de-bc4e-4e36f46d5281 service nova] Creating event network-vif-plugged:0e876440-c9c1-4ed0-be90-0af7d5fd38fe for instance 02795c57-88a4-46ac-be72-8c43dc178e4f on hv-cinder-79053 Jun 04 18:40:47.930639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-e4dfd2eb-fa08-4089-b4cc-1fbb98f454ee req-17d314b1-5bfb-46de-bc4e-4e36f46d5281 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165948 Jun 04 18:40:47.933722 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 484/955] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:40:48.061873 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c6ae4934-84d2-492b-afff-cbef4038ef28 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:48.071310 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c6ae4934-84d2-492b-afff-cbef4038ef28 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.192009 Jun 04 18:40:48.071866 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 472/956] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:47 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:48.201645 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:48.202708 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:48.209507 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:48.209928 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:48.210953 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:48.211379 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:48.346366 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:48.361725 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:48.363320 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:48.364474 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a8f86d6d-d908-42bc-89f6-7e1aae08a963 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.167969 Jun 04 18:40:48.365034 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 485/957] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:48 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:49.092843 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8f2bc928-c7d9-4a18-b3b0-2e719531d7f1 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:49.093635 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8f2bc928-c7d9-4a18-b3b0-2e719531d7f1 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:49.100457 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8f2bc928-c7d9-4a18-b3b0-2e719531d7f1 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:49.100908 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8f2bc928-c7d9-4a18-b3b0-2e719531d7f1 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:49.101683 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8f2bc928-c7d9-4a18-b3b0-2e719531d7f1 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:49.102122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8f2bc928-c7d9-4a18-b3b0-2e719531d7f1 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:49.253927 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8f2bc928-c7d9-4a18-b3b0-2e719531d7f1 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:49.261892 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8f2bc928-c7d9-4a18-b3b0-2e719531d7f1 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.175008 Jun 04 18:40:49.262484 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 473/958] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:49 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:49.383346 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:49.384395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:49.393091 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:49.393557 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:49.394370 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:49.394807 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:49.542727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:49.551416 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:49.553391 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:49.554646 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c3a29bd7-e3c1-4aa2-9e64-8a7df2e67fae tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1406 microversion: 2.20 time: 0.175555 Jun 04 18:40:49.555389 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 486/959] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:49 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:49.946195 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-62b2b8c3-f200-475a-a59a-e532e15676a7 req-915a98e3-af9c-4901-83c6-a71c0a105816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d75266f-49ff-434a-aedf-33ee2c9aa1f6", "name": "network-vif-plugged", "status": "completed", "tag": "aaff41ef-ea9c-4fbb-aca7-6e83376b98f6"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:49.949729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:49.956308 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-62b2b8c3-f200-475a-a59a-e532e15676a7 req-915a98e3-af9c-4901-83c6-a71c0a105816 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:49.956762 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-62b2b8c3-f200-475a-a59a-e532e15676a7 req-915a98e3-af9c-4901-83c6-a71c0a105816 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:49.969549 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-62b2b8c3-f200-475a-a59a-e532e15676a7 req-915a98e3-af9c-4901-83c6-a71c0a105816 service nova] Creating event network-vif-plugged:aaff41ef-ea9c-4fbb-aca7-6e83376b98f6 for instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 on hv-cinder-79053 Jun 04 18:40:49.974595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-62b2b8c3-f200-475a-a59a-e532e15676a7 req-915a98e3-af9c-4901-83c6-a71c0a105816 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032348 Jun 04 18:40:49.975172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 474/960] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:40:50.280373 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b34433d5-cc43-4f3e-945d-2a43fdfbd102 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:50.280983 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b34433d5-cc43-4f3e-945d-2a43fdfbd102 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:50.283078 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:50.289699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b34433d5-cc43-4f3e-945d-2a43fdfbd102 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:50.290106 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b34433d5-cc43-4f3e-945d-2a43fdfbd102 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:50.290892 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b34433d5-cc43-4f3e-945d-2a43fdfbd102 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:50.291330 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b34433d5-cc43-4f3e-945d-2a43fdfbd102 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:50.506951 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b34433d5-cc43-4f3e-945d-2a43fdfbd102 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:50.517890 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b34433d5-cc43-4f3e-945d-2a43fdfbd102 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.241740 Jun 04 18:40:50.518442 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 487/961] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:50 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:50.578454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:50.579565 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:50.586709 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:50.587182 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:50.588035 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:50.588472 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:50.727100 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:50.735329 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:50.736899 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:50.738047 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-be2a66db-6d11-4b43-bd8d-5fc287e9a3dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1598 microversion: 2.20 time: 0.167505 Jun 04 18:40:50.738605 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 475/962] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:40:50 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:40:50.758481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0bf83521-8bfc-40a5-8e9a-5507974fb7dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:50.759145 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0bf83521-8bfc-40a5-8e9a-5507974fb7dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:50.766443 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bf83521-8bfc-40a5-8e9a-5507974fb7dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:50.766992 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bf83521-8bfc-40a5-8e9a-5507974fb7dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:50.767797 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bf83521-8bfc-40a5-8e9a-5507974fb7dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:50.768272 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bf83521-8bfc-40a5-8e9a-5507974fb7dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:50.856663 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0bf83521-8bfc-40a5-8e9a-5507974fb7dc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104161 Jun 04 18:40:50.857242 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 488/963] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 4 18:40:50 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:40:51.535193 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b81ba620-4d92-439e-b4ed-8c32ff1f4b15 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:51.535797 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b81ba620-4d92-439e-b4ed-8c32ff1f4b15 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:51.542170 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b81ba620-4d92-439e-b4ed-8c32ff1f4b15 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:51.542623 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b81ba620-4d92-439e-b4ed-8c32ff1f4b15 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:51.543386 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b81ba620-4d92-439e-b4ed-8c32ff1f4b15 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:51.543830 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b81ba620-4d92-439e-b4ed-8c32ff1f4b15 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:51.697388 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b81ba620-4d92-439e-b4ed-8c32ff1f4b15 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:51.705264 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b81ba620-4d92-439e-b4ed-8c32ff1f4b15 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1265 microversion: 2.1 time: 0.174432 Jun 04 18:40:51.705959 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 476/964] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:51 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:51.854046 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-f2ea12a5-f9a6-4aec-9888-6f19b95bf744 req-c1c5dbd5-a323-4dc3-966c-930c0453c8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02795c57-88a4-46ac-be72-8c43dc178e4f", "tag": "0e876440-c9c1-4ed0-be90-0af7d5fd38fe"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:51.862943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-f2ea12a5-f9a6-4aec-9888-6f19b95bf744 req-c1c5dbd5-a323-4dc3-966c-930c0453c8ce service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:51.863495 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-f2ea12a5-f9a6-4aec-9888-6f19b95bf744 req-c1c5dbd5-a323-4dc3-966c-930c0453c8ce service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:51.874966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-f2ea12a5-f9a6-4aec-9888-6f19b95bf744 req-c1c5dbd5-a323-4dc3-966c-930c0453c8ce service nova] Creating event network-changed:0e876440-c9c1-4ed0-be90-0af7d5fd38fe for instance 02795c57-88a4-46ac-be72-8c43dc178e4f on hv-cinder-79053 Jun 04 18:40:51.880216 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-f2ea12a5-f9a6-4aec-9888-6f19b95bf744 req-c1c5dbd5-a323-4dc3-966c-930c0453c8ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035326 Jun 04 18:40:51.881153 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 489/965] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:40:52.727659 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8310514a-ac4e-4a27-8bf6-c8eb6350cbcc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:52.729374 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8310514a-ac4e-4a27-8bf6-c8eb6350cbcc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:52.735852 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8310514a-ac4e-4a27-8bf6-c8eb6350cbcc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:52.736367 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8310514a-ac4e-4a27-8bf6-c8eb6350cbcc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:52.737151 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8310514a-ac4e-4a27-8bf6-c8eb6350cbcc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:52.737584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8310514a-ac4e-4a27-8bf6-c8eb6350cbcc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:52.901611 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8310514a-ac4e-4a27-8bf6-c8eb6350cbcc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:52.911018 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8310514a-ac4e-4a27-8bf6-c8eb6350cbcc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1453 microversion: 2.1 time: 0.192556 Jun 04 18:40:52.912103 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 477/966] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:52 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:52.929431 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d1ff58e-54ee-451b-9c79-e68b17905d36 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:40:52.930814 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7d1ff58e-54ee-451b-9c79-e68b17905d36 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:40:52.937244 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d1ff58e-54ee-451b-9c79-e68b17905d36 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:52.937980 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d1ff58e-54ee-451b-9c79-e68b17905d36 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:52.939566 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d1ff58e-54ee-451b-9c79-e68b17905d36 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:52.940254 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d1ff58e-54ee-451b-9c79-e68b17905d36 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:53.085194 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d1ff58e-54ee-451b-9c79-e68b17905d36 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:40:53.093069 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7d1ff58e-54ee-451b-9c79-e68b17905d36 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1453 microversion: 2.1 time: 0.168391 Jun 04 18:40:53.093639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 490/967] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:40:52 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:40:55.254706 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-ad140e9f-0250-4bdf-9ca5-8fbb6a87cb3e req-d25fe3b1-976c-4b37-8bb9-d28791374eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d75266f-49ff-434a-aedf-33ee2c9aa1f6", "tag": "aaff41ef-ea9c-4fbb-aca7-6e83376b98f6"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:40:55.263416 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ad140e9f-0250-4bdf-9ca5-8fbb6a87cb3e req-d25fe3b1-976c-4b37-8bb9-d28791374eef service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:40:55.263863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ad140e9f-0250-4bdf-9ca5-8fbb6a87cb3e req-d25fe3b1-976c-4b37-8bb9-d28791374eef service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:40:55.275157 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-ad140e9f-0250-4bdf-9ca5-8fbb6a87cb3e req-d25fe3b1-976c-4b37-8bb9-d28791374eef service nova] Creating event network-changed:aaff41ef-ea9c-4fbb-aca7-6e83376b98f6 for instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 on hv-cinder-79053 Jun 04 18:40:55.280388 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-ad140e9f-0250-4bdf-9ca5-8fbb6a87cb3e req-d25fe3b1-976c-4b37-8bb9-d28791374eef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029408 Jun 04 18:40:55.280978 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 478/968] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:42:12.037298 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:42:12.038216 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Sat Jun 4 18:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 18:42:37.306292 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR oslo.messaging._drivers.impl_rabbit [-] [398ea705-2bcd-4eea-b678-112f1ce9ac28] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 04 18:42:37.306928 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=7 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:42:37.307642 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=44 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:42:37.486633 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-36612169-ed37-4650-ab71-afcf12c74e0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:37.487146 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-36612169-ed37-4650-ab71-afcf12c74e0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:37.493989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36612169-ed37-4650-ab71-afcf12c74e0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:37.494444 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36612169-ed37-4650-ab71-afcf12c74e0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:37.495220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36612169-ed37-4650-ab71-afcf12c74e0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:37.495659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36612169-ed37-4650-ab71-afcf12c74e0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:37.519415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-36612169-ed37-4650-ab71-afcf12c74e0a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/ips" status: 200 len: 151 microversion: 2.20 time: 0.215465 Jun 04 18:42:37.519968 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 491/969] 10.222.0.39 () {60 vars in 1288 bytes} [Sat Jun 4 18:42:37 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/ips => generated 151 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:42:39.331516 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=9 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:42:39.332293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=76 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:42:39.337122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fb34305b-a38a-4d67-8166-486784a20c6d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:42:39.337122 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fb34305b-a38a-4d67-8166-486784a20c6d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:39.345294 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb34305b-a38a-4d67-8166-486784a20c6d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:39.345747 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb34305b-a38a-4d67-8166-486784a20c6d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:39.346504 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb34305b-a38a-4d67-8166-486784a20c6d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:39.346962 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb34305b-a38a-4d67-8166-486784a20c6d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:39.371672 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-fb34305b-a38a-4d67-8166-486784a20c6d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lazy-loading 'flavor' on Instance uuid 02795c57-88a4-46ac-be72-8c43dc178e4f {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:42:39.638279 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fb34305b-a38a-4d67-8166-486784a20c6d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/action" status: 202 len: 0 microversion: 2.20 time: 0.308763 Jun 04 18:42:39.639006 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 479/970] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 4 18:42:39 2022] POST /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:42:39.647798 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:39.648415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:39.656727 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:39.657232 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:39.658308 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:39.658739 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:39.679090 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] [398ea705-2bcd-4eea-b678-112f1ce9ac28] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47620. Jun 04 18:42:40.031456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:40.044320 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:40.046596 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:40.048412 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1d51f168-b2f7-497a-a177-955531ac19b1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.404627 Jun 04 18:42:40.049182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 492/971] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:39 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:42:41.072441 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:41.073127 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:41.080641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:41.081148 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:41.082004 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:41.082493 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:41.220522 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:41.229164 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:41.230675 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:41.231847 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0eae3717-1747-42ce-8c97-21f081f479a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.166944 Jun 04 18:42:41.232433 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 480/972] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:41 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:42.251290 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:42.251943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:42.259289 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:42.259942 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:42.261219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:42.261929 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:42.403395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:42.415014 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:42.416632 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:42.417752 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-80efbdc2-0669-4fda-87bf-a2afd7b26cd5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.170784 Jun 04 18:42:42.418355 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 493/973] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:42 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:43.440535 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:43.441590 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:43.450508 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:43.450959 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:43.451727 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:43.452208 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:43.589621 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:43.598148 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:43.599648 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:43.600841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-14757a79-e678-4b1a-85d6-5f96de37f99c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.166990 Jun 04 18:42:43.601406 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 481/974] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:43 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:42:44.623746 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:44.624675 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:44.643238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:44.643997 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:44.645303 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:44.646050 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:44.797482 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:44.805778 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:44.807301 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:44.808497 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-515a53ed-7be3-4a93-bc66-a695df0a0832 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.192204 Jun 04 18:42:44.809057 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 494/975] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:44 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:45.831330 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:45.832376 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:45.843700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:45.844505 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:45.845775 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:45.846509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:46.010090 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:46.022237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:46.024777 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:46.026266 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3137c7f2-0304-4432-bc94-b83304094a1c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.201736 Jun 04 18:42:46.027110 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 482/976] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:45 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:47.057079 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:47.057997 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:47.068962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:47.069717 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:47.070990 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:47.071719 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:47.211484 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:47.220037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:47.221545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:47.222725 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0cefc460-b3a6-4212-ba81-c03e0301add6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.172719 Jun 04 18:42:47.223296 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 495/977] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:47 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:48.245196 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:48.246300 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:48.252965 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:48.253410 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:48.254171 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:48.254601 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:48.386472 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:48.395003 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:48.396528 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:48.397698 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ed1ec827-e42f-4daa-9060-37175517b389 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.159063 Jun 04 18:42:48.398299 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 483/978] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:48 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:49.421560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:49.422584 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:49.434145 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:49.434945 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:49.436467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:49.437219 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:49.579833 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:49.590306 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:49.592898 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:49.594588 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-022ce111-8314-49ce-8c5f-8f1752f463cc tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.180029 Jun 04 18:42:49.595309 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 496/979] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:49 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:50.618739 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:50.619598 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:50.627464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:50.627937 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:50.628738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:50.629173 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:50.760994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:50.769675 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:50.771165 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:50.772355 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fe27b03f-894b-48bb-acf1-69dab3aa3f3d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.160373 Jun 04 18:42:50.772922 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 484/980] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:50 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:51.791465 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:51.792102 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:51.799214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:51.799657 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:51.800456 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:51.800884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:51.941187 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:51.949773 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:51.951286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:51.952486 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c21b60cb-bb82-4b0e-ab14-94f13b5294cf tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.165011 Jun 04 18:42:51.953054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 497/981] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:51 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:52.975355 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:52.976395 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:52.985398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:52.985850 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:52.986618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:52.987052 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:53.124157 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:53.132431 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:53.133933 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:53.135094 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-35b063e8-52ea-45c0-871d-ce92601ac3d2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1743 microversion: 2.20 time: 0.166654 Jun 04 18:42:53.135660 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 485/982] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:52 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:54.154683 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:54.155481 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:54.162947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:54.163394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:54.164192 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:54.164623 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:54.298553 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:54.307854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:54.309415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:54.310591 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ece3c8dd-1c47-4c8f-82b8-26c08f429dc9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1743 microversion: 2.20 time: 0.160028 Jun 04 18:42:54.311613 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 498/983] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:54 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:55.329570 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:55.331452 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:55.337205 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:55.337652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:55.338423 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:55.338906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:55.357318 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-66d79e7f-26b6-4416-a381-f6d3805ad3ed tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:42:55.358687 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-66d79e7f-26b6-4416-a381-f6d3805ad3ed tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:55.366028 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66d79e7f-26b6-4416-a381-f6d3805ad3ed tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:55.366431 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66d79e7f-26b6-4416-a381-f6d3805ad3ed tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:55.367358 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66d79e7f-26b6-4416-a381-f6d3805ad3ed tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:55.367795 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66d79e7f-26b6-4416-a381-f6d3805ad3ed tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:55.391731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-66d79e7f-26b6-4416-a381-f6d3805ad3ed tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lazy-loading 'flavor' on Instance uuid e2ab534c-de63-4e2e-84a4-ed1072d868d5 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:42:55.469820 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-66d79e7f-26b6-4416-a381-f6d3805ad3ed tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "POST /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5/action" status: 202 len: 0 microversion: 2.1 time: 0.116183 Jun 04 18:42:55.470425 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 499/984] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:42:55 2022] POST /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:42:55.479393 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-71a8e7cc-c98f-43dc-a6c6-20682dada1d9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:55.480134 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-71a8e7cc-c98f-43dc-a6c6-20682dada1d9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:55.486996 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-71a8e7cc-c98f-43dc-a6c6-20682dada1d9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:55.487244 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:55.487510 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-71a8e7cc-c98f-43dc-a6c6-20682dada1d9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:55.488322 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-71a8e7cc-c98f-43dc-a6c6-20682dada1d9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:55.488868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-71a8e7cc-c98f-43dc-a6c6-20682dada1d9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:55.498225 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:55.500596 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:55.501952 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-65cbc073-9316-4644-85b7-c480bb0d13bd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1743 microversion: 2.20 time: 0.176369 Jun 04 18:42:55.502767 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 486/985] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:55 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:55.621990 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-71a8e7cc-c98f-43dc-a6c6-20682dada1d9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:55.630075 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-71a8e7cc-c98f-43dc-a6c6-20682dada1d9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.154754 Jun 04 18:42:55.630651 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 500/986] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:42:55 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:42:56.238027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-068bbd73-3117-4001-a99c-e2475e5319d0 req-33e7c5e9-8e79-4bee-89d9-fe5d11b9603b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02795c57-88a4-46ac-be72-8c43dc178e4f", "name": "network-vif-plugged", "status": "completed", "tag": "0e876440-c9c1-4ed0-be90-0af7d5fd38fe"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:42:56.246553 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-068bbd73-3117-4001-a99c-e2475e5319d0 req-33e7c5e9-8e79-4bee-89d9-fe5d11b9603b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:56.247002 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-068bbd73-3117-4001-a99c-e2475e5319d0 req-33e7c5e9-8e79-4bee-89d9-fe5d11b9603b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:56.259183 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-068bbd73-3117-4001-a99c-e2475e5319d0 req-33e7c5e9-8e79-4bee-89d9-fe5d11b9603b service nova] Creating event network-vif-plugged:0e876440-c9c1-4ed0-be90-0af7d5fd38fe for instance 02795c57-88a4-46ac-be72-8c43dc178e4f on hv-cinder-79053 Jun 04 18:42:56.264691 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-068bbd73-3117-4001-a99c-e2475e5319d0 req-33e7c5e9-8e79-4bee-89d9-fe5d11b9603b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029982 Jun 04 18:42:56.265327 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 487/987] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:42:56.525803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:56.526460 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:56.537650 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:56.538324 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:56.539439 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:56.540073 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:56.648277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c8e6f4ae-d0dd-4b28-94d4-ad48d401a6ca tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:56.648987 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c8e6f4ae-d0dd-4b28-94d4-ad48d401a6ca tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:56.655944 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8e6f4ae-d0dd-4b28-94d4-ad48d401a6ca tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:56.656440 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8e6f4ae-d0dd-4b28-94d4-ad48d401a6ca tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:56.657483 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8e6f4ae-d0dd-4b28-94d4-ad48d401a6ca tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:56.657931 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8e6f4ae-d0dd-4b28-94d4-ad48d401a6ca tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:56.682746 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:56.691321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:56.692877 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:56.694032 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0717248b-6922-4bad-9724-3d435c1c1e9f tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1743 microversion: 2.20 time: 0.174754 Jun 04 18:42:56.694592 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 501/988] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:56 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:56.796366 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c8e6f4ae-d0dd-4b28-94d4-ad48d401a6ca tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:56.804572 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c8e6f4ae-d0dd-4b28-94d4-ad48d401a6ca tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.161247 Jun 04 18:42:56.805144 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 488/989] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:42:56 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:42:57.716671 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:57.717749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:57.724731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:57.725212 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:57.725971 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:57.726406 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:57.821646 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-38b6d712-32b0-4cab-9a99-47a293c9c229 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:57.822223 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-38b6d712-32b0-4cab-9a99-47a293c9c229 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:57.829277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-38b6d712-32b0-4cab-9a99-47a293c9c229 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:57.829740 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-38b6d712-32b0-4cab-9a99-47a293c9c229 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:57.830507 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-38b6d712-32b0-4cab-9a99-47a293c9c229 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:57.830949 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-38b6d712-32b0-4cab-9a99-47a293c9c229 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:57.873748 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:57.883322 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:57.885333 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:57.886635 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e0c24da5-3e52-4a3b-8f53-f372903ac3a2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1743 microversion: 2.20 time: 0.176677 Jun 04 18:42:57.892518 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 502/990] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:57 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:57.968823 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-38b6d712-32b0-4cab-9a99-47a293c9c229 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:57.976588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-38b6d712-32b0-4cab-9a99-47a293c9c229 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.158829 Jun 04 18:42:57.977159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 489/991] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:42:57 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:42:58.905523 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:58.906927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:58.929939 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:58.930386 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:58.931173 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:58.931604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:58.994951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9b930693-5603-4696-b3c0-30b9aa038ec2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:42:58.995563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9b930693-5603-4696-b3c0-30b9aa038ec2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:42:59.003627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9b930693-5603-4696-b3c0-30b9aa038ec2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:59.004330 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9b930693-5603-4696-b3c0-30b9aa038ec2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:59.007400 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9b930693-5603-4696-b3c0-30b9aa038ec2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:42:59.008148 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9b930693-5603-4696-b3c0-30b9aa038ec2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:42:59.078446 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:59.089415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:59.091042 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:59.092710 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bb8bebc8-ef9c-4ad5-a042-8be7e0aaec28 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1738 microversion: 2.20 time: 0.190977 Jun 04 18:42:59.093960 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 503/992] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:42:58 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:42:59.187271 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9b930693-5603-4696-b3c0-30b9aa038ec2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:42:59.195224 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9b930693-5603-4696-b3c0-30b9aa038ec2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.204416 Jun 04 18:42:59.195789 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 490/993] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:42:58 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:43:00.112620 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:00.113221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:00.120246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:00.120994 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:00.121782 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:00.122220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:00.214727 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b9c75f65-66ca-4e2d-8e19-26f652243e47 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:00.215592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b9c75f65-66ca-4e2d-8e19-26f652243e47 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:00.223627 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b9c75f65-66ca-4e2d-8e19-26f652243e47 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:00.224529 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b9c75f65-66ca-4e2d-8e19-26f652243e47 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:00.225725 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b9c75f65-66ca-4e2d-8e19-26f652243e47 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:00.226573 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b9c75f65-66ca-4e2d-8e19-26f652243e47 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:00.279690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:00.297567 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:00.299332 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:00.300556 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-eed3f60e-f731-4c57-a790-96b7a3ed4647 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1738 microversion: 2.20 time: 0.192364 Jun 04 18:43:00.311904 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 504/994] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:00 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:00.396105 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b9c75f65-66ca-4e2d-8e19-26f652243e47 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:00.407231 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b9c75f65-66ca-4e2d-8e19-26f652243e47 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.197891 Jun 04 18:43:00.418409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 491/995] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:00 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:01.319335 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:01.319907 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:01.326895 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:01.327659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:01.328478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:01.329157 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:01.427082 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-75ea2746-8bde-4e53-b7dc-6296878d36ef tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:01.427675 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-75ea2746-8bde-4e53-b7dc-6296878d36ef tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:01.434595 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-75ea2746-8bde-4e53-b7dc-6296878d36ef tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:01.435059 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-75ea2746-8bde-4e53-b7dc-6296878d36ef tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:01.435844 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-75ea2746-8bde-4e53-b7dc-6296878d36ef tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:01.436398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-75ea2746-8bde-4e53-b7dc-6296878d36ef tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:01.512221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:01.516394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:01.531718 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:01.534774 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:01.537014 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cad44dcf-9a85-4cda-833a-da708b8dda59 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1738 microversion: 2.20 time: 0.222048 Jun 04 18:43:01.537838 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 505/996] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:01 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:01.604951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-75ea2746-8bde-4e53-b7dc-6296878d36ef tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:01.614758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-75ea2746-8bde-4e53-b7dc-6296878d36ef tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.191519 Jun 04 18:43:01.615492 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 492/997] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:01 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:02.562906 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:02.563919 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:02.571512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:02.571956 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:02.572766 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:02.573283 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:02.632499 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8294d0a8-27b1-48b5-bb98-38e7df80ea15 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:02.633918 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8294d0a8-27b1-48b5-bb98-38e7df80ea15 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:02.642782 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8294d0a8-27b1-48b5-bb98-38e7df80ea15 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:02.643643 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8294d0a8-27b1-48b5-bb98-38e7df80ea15 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:02.644723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8294d0a8-27b1-48b5-bb98-38e7df80ea15 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:02.645373 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8294d0a8-27b1-48b5-bb98-38e7df80ea15 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:02.803830 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8294d0a8-27b1-48b5-bb98-38e7df80ea15 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:02.813961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8294d0a8-27b1-48b5-bb98-38e7df80ea15 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.183691 Jun 04 18:43:02.816401 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 493/998] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:02 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:43:02.905502 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:02.917864 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:02.920704 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:02.922618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5c26338e-ba44-4e32-bbb3-8dfa2d10a8c6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1738 microversion: 2.20 time: 0.370848 Jun 04 18:43:02.923393 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 506/999] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:02 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1738 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:03.843975 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-442cb4ac-911e-4dec-8a36-d61ecfc19195 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:03.846931 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-442cb4ac-911e-4dec-8a36-d61ecfc19195 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:03.855897 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-442cb4ac-911e-4dec-8a36-d61ecfc19195 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:03.855897 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-442cb4ac-911e-4dec-8a36-d61ecfc19195 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:03.856532 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-442cb4ac-911e-4dec-8a36-d61ecfc19195 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:03.856971 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-442cb4ac-911e-4dec-8a36-d61ecfc19195 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:03.862814 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:03.943220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:03.945331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:03.954522 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:03.954974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:03.955767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:03.956491 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:04.027199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-442cb4ac-911e-4dec-8a36-d61ecfc19195 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:04.040518 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-442cb4ac-911e-4dec-8a36-d61ecfc19195 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.208838 Jun 04 18:43:04.041925 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 494/1000] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:03 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:04.130731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:04.141183 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:04.142685 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:04.143997 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-efd29928-2284-4dfa-aea3-c4cbd3d124a6 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1738 microversion: 2.20 time: 0.205187 Jun 04 18:43:04.156190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 507/1001] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:03 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:43:05.058619 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-afe44b45-3f60-4224-a599-47634a238ac6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:05.059211 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-afe44b45-3f60-4224-a599-47634a238ac6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:05.067641 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afe44b45-3f60-4224-a599-47634a238ac6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:05.068419 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afe44b45-3f60-4224-a599-47634a238ac6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:05.069483 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afe44b45-3f60-4224-a599-47634a238ac6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:05.069926 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afe44b45-3f60-4224-a599-47634a238ac6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:05.164279 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:05.165952 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:05.173310 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:05.174182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:05.175281 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:05.176328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:05.235347 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-afe44b45-3f60-4224-a599-47634a238ac6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:05.244952 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-afe44b45-3f60-4224-a599-47634a238ac6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.190124 Jun 04 18:43:05.245566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 495/1002] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:05 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:05.353022 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:05.363817 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:05.366099 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:05.367688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-718616e9-5c51-4e17-baef-7f4b4ec5e2d9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1738 microversion: 2.20 time: 0.207684 Jun 04 18:43:05.368587 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 508/1003] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:05 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:43:06.263044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cdff4d6b-e30b-4103-aefd-30a08ed46a68 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:06.264983 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cdff4d6b-e30b-4103-aefd-30a08ed46a68 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:06.274513 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cdff4d6b-e30b-4103-aefd-30a08ed46a68 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:06.275362 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cdff4d6b-e30b-4103-aefd-30a08ed46a68 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:06.276447 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cdff4d6b-e30b-4103-aefd-30a08ed46a68 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:06.277107 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cdff4d6b-e30b-4103-aefd-30a08ed46a68 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:06.388427 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:06.389113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:06.402986 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:06.403447 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:06.404333 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:06.404849 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:06.437164 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cdff4d6b-e30b-4103-aefd-30a08ed46a68 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:06.449342 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cdff4d6b-e30b-4103-aefd-30a08ed46a68 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.190240 Jun 04 18:43:06.450193 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 496/1004] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:06 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:06.606459 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:06.620832 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:06.622321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:06.623891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fa4dea1b-c16c-41b1-b739-c7b9380eaa7c tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1738 microversion: 2.20 time: 0.239735 Jun 04 18:43:06.624612 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 509/1005] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:06 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:07.489930 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0f6cf8a6-f726-486b-b787-7394d8bfb563 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:07.490959 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0f6cf8a6-f726-486b-b787-7394d8bfb563 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:07.501515 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f6cf8a6-f726-486b-b787-7394d8bfb563 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:07.501967 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f6cf8a6-f726-486b-b787-7394d8bfb563 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:07.502733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f6cf8a6-f726-486b-b787-7394d8bfb563 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:07.503171 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f6cf8a6-f726-486b-b787-7394d8bfb563 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:07.637067 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0f6cf8a6-f726-486b-b787-7394d8bfb563 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:07.644228 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:07.644873 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:07.645551 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0f6cf8a6-f726-486b-b787-7394d8bfb563 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.161123 Jun 04 18:43:07.646121 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 497/1006] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:07 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:07.648240 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=39 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:07.652373 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:07.652791 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:07.653577 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:07.654016 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:07.796384 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:07.804682 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:07.806204 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:07.807352 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-75d66c87-f069-4346-81a5-c576b81ef870 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1738 microversion: 2.20 time: 0.167833 Jun 04 18:43:07.807955 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 510/1007] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:07 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:08.666829 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bbeea98e-77c9-4407-b567-ae519e0f98c5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:08.667695 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bbeea98e-77c9-4407-b567-ae519e0f98c5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:08.675462 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbeea98e-77c9-4407-b567-ae519e0f98c5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:08.675920 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbeea98e-77c9-4407-b567-ae519e0f98c5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:08.676733 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbeea98e-77c9-4407-b567-ae519e0f98c5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:08.677173 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bbeea98e-77c9-4407-b567-ae519e0f98c5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:08.823481 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bbeea98e-77c9-4407-b567-ae519e0f98c5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:08.826216 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:08.826793 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:08.832090 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bbeea98e-77c9-4407-b567-ae519e0f98c5 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.172085 Jun 04 18:43:08.832861 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 498/1008] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:08 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:08.833602 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:08.834053 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:08.834818 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:08.835253 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:08.974663 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:08.987020 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:08.989421 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:08.991156 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-799e52e9-39ba-445e-bf7a-965f1d4d01f8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1720 microversion: 2.20 time: 0.168582 Jun 04 18:43:08.991940 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 511/1009] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:08 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:09.850027 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6098621c-f496-421e-a377-51d99b690802 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:09.850651 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6098621c-f496-421e-a377-51d99b690802 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:09.853131 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=41 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:09.858827 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6098621c-f496-421e-a377-51d99b690802 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:09.859293 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6098621c-f496-421e-a377-51d99b690802 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:09.860114 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6098621c-f496-421e-a377-51d99b690802 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:09.860549 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6098621c-f496-421e-a377-51d99b690802 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:09.998787 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6098621c-f496-421e-a377-51d99b690802 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:10.007130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6098621c-f496-421e-a377-51d99b690802 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.161047 Jun 04 18:43:10.007883 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 499/1010] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:09 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:10.011028 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:10.011642 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:10.018664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:10.019113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:10.019884 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:10.020346 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:10.166024 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:10.174566 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:10.176089 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:10.177250 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bfb20647-49a4-4667-959c-0132694dc489 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1720 microversion: 2.20 time: 0.170413 Jun 04 18:43:10.177818 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 512/1011] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:10 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:11.025401 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c425f174-8062-4ad4-aa62-540b1445b81d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:11.026106 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c425f174-8062-4ad4-aa62-540b1445b81d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:11.033560 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c425f174-8062-4ad4-aa62-540b1445b81d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:11.034189 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c425f174-8062-4ad4-aa62-540b1445b81d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:11.035009 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c425f174-8062-4ad4-aa62-540b1445b81d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:11.035817 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c425f174-8062-4ad4-aa62-540b1445b81d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:11.176209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c425f174-8062-4ad4-aa62-540b1445b81d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:11.184046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c425f174-8062-4ad4-aa62-540b1445b81d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.162523 Jun 04 18:43:11.184620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 500/1012] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:11 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:11.200221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:11.200615 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:11.207470 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:11.207920 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:11.208764 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:11.209194 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:11.348648 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:11.356819 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:11.358311 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:11.359468 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b30f71a1-3453-4bc3-9f33-5d106d747df4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1663 microversion: 2.20 time: 0.163477 Jun 04 18:43:11.360035 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 513/1013] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:11 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:11.382090 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-84a7a3b0-296b-4310-89c6-1ab4570c38bb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3620c5a1-e5e7-4a51-a4a6-8762f1858203"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:11.383738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-84a7a3b0-296b-4310-89c6-1ab4570c38bb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:11.393797 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84a7a3b0-296b-4310-89c6-1ab4570c38bb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:11.394247 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84a7a3b0-296b-4310-89c6-1ab4570c38bb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:11.395015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84a7a3b0-296b-4310-89c6-1ab4570c38bb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:11.395451 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84a7a3b0-296b-4310-89c6-1ab4570c38bb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:11.696770 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-84a7a3b0-296b-4310-89c6-1ab4570c38bb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321501 Jun 04 18:43:11.697365 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 501/1014] 10.222.0.39 () {62 vars in 1363 bytes} [Sat Jun 4 18:43:11 2022] POST /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 18:43:11.815672 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0972784a-ff94-41ef-a872-c795bf5dcfb9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:11.816224 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0972784a-ff94-41ef-a872-c795bf5dcfb9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:11.822666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0972784a-ff94-41ef-a872-c795bf5dcfb9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:11.823062 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0972784a-ff94-41ef-a872-c795bf5dcfb9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:11.823825 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0972784a-ff94-41ef-a872-c795bf5dcfb9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:11.824370 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0972784a-ff94-41ef-a872-c795bf5dcfb9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:12.086153 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0972784a-ff94-41ef-a872-c795bf5dcfb9 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "DELETE /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/os-volume_attachments/3620c5a1-e5e7-4a51-a4a6-8762f1858203" status: 202 len: 0 microversion: 2.20 time: 0.275085 Jun 04 18:43:12.086776 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 514/1015] 10.222.0.39 () {60 vars in 1456 bytes} [Sat Jun 4 18:43:11 2022] DELETE /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/os-volume_attachments/3620c5a1-e5e7-4a51-a4a6-8762f1858203 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:43:12.142782 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b7bce6ab-7adf-4995-adbe-c7563bca4a5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:12.143443 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b7bce6ab-7adf-4995-adbe-c7563bca4a5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:12.151292 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7bce6ab-7adf-4995-adbe-c7563bca4a5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:12.152076 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7bce6ab-7adf-4995-adbe-c7563bca4a5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:12.153150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7bce6ab-7adf-4995-adbe-c7563bca4a5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:12.153714 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7bce6ab-7adf-4995-adbe-c7563bca4a5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:12.206527 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-49c90e03-50ce-4680-9074-4599de920c70 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:12.207632 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-49c90e03-50ce-4680-9074-4599de920c70 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:12.218949 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49c90e03-50ce-4680-9074-4599de920c70 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:12.219931 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49c90e03-50ce-4680-9074-4599de920c70 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:12.221422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49c90e03-50ce-4680-9074-4599de920c70 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:12.222211 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49c90e03-50ce-4680-9074-4599de920c70 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:12.263221 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b7bce6ab-7adf-4995-adbe-c7563bca4a5d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "POST /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/action" status: 202 len: 0 microversion: 2.20 time: 0.124245 Jun 04 18:43:12.270028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 502/1016] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 4 18:43:12 2022] POST /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:43:12.278075 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-1515cdc5-f2f8-4b77-9250-ca77fc87e779 req-5fb22998-0c2d-49ad-86fe-d2674edea0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02795c57-88a4-46ac-be72-8c43dc178e4f", "name": "network-vif-unplugged", "status": "completed", "tag": "0e876440-c9c1-4ed0-be90-0af7d5fd38fe"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:12.293117 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-1515cdc5-f2f8-4b77-9250-ca77fc87e779 req-5fb22998-0c2d-49ad-86fe-d2674edea0bd service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:12.294055 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-1515cdc5-f2f8-4b77-9250-ca77fc87e779 req-5fb22998-0c2d-49ad-86fe-d2674edea0bd service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:12.310349 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.compute.server_external_events [req-1515cdc5-f2f8-4b77-9250-ca77fc87e779 req-5fb22998-0c2d-49ad-86fe-d2674edea0bd service nova] Unable to find a host for instance 02795c57-88a4-46ac-be72-8c43dc178e4f. Dropping event network-vif-unplugged {{(pid=117731) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 18:43:12.311250 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-1515cdc5-f2f8-4b77-9250-ca77fc87e779 req-5fb22998-0c2d-49ad-86fe-d2674edea0bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039638 Jun 04 18:43:12.311847 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 503/1017] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 04 18:43:12.316878 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:12.317584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:12.324639 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:12.325200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:12.326030 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:12.326640 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:12.411452 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-49c90e03-50ce-4680-9074-4599de920c70 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:12.419757 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-49c90e03-50ce-4680-9074-4599de920c70 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.221532 Jun 04 18:43:12.420395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 515/1018] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:12 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:12.486944 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:12.495398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:12.497028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:12.498214 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cbcc6982-96e3-4cce-bc8e-2c236cdaed34 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1671 microversion: 2.20 time: 0.185315 Jun 04 18:43:12.498749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 504/1019] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:12 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:13.437815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-477304fd-c76e-4a58-84dd-bdecf75f2951 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:13.438776 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-477304fd-c76e-4a58-84dd-bdecf75f2951 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:13.446193 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-477304fd-c76e-4a58-84dd-bdecf75f2951 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:13.446815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-477304fd-c76e-4a58-84dd-bdecf75f2951 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:13.447779 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-477304fd-c76e-4a58-84dd-bdecf75f2951 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:13.448364 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-477304fd-c76e-4a58-84dd-bdecf75f2951 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:13.519477 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:13.520141 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:13.527224 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:13.528032 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:13.528838 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:13.529299 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:13.678703 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:13.686941 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:13.688750 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:13.690164 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5c8eace3-30c5-4da5-bb19-45d25e4d56b4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.176730 Jun 04 18:43:13.690709 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 505/1020] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:13 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:43:13.927896 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-477304fd-c76e-4a58-84dd-bdecf75f2951 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:13.944792 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-477304fd-c76e-4a58-84dd-bdecf75f2951 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1566 microversion: 2.1 time: 0.511060 Jun 04 18:43:13.946385 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 516/1021] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:13 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1566 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:13.951824 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-e3200be3-a4c2-4729-8473-83c6fbb05f55 req-b30fd89a-85f8-45ee-8166-0dc2956d9891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d75266f-49ff-434a-aedf-33ee2c9aa1f6", "tag": "aaff41ef-ea9c-4fbb-aca7-6e83376b98f6"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:13.959157 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-04794bcb-24cd-4eb0-b37c-92f99db1bdb2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:13.959674 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-04794bcb-24cd-4eb0-b37c-92f99db1bdb2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:13.961752 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e3200be3-a4c2-4729-8473-83c6fbb05f55 req-b30fd89a-85f8-45ee-8166-0dc2956d9891 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:13.962498 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e3200be3-a4c2-4729-8473-83c6fbb05f55 req-b30fd89a-85f8-45ee-8166-0dc2956d9891 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:13.966143 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04794bcb-24cd-4eb0-b37c-92f99db1bdb2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:13.968113 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04794bcb-24cd-4eb0-b37c-92f99db1bdb2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:13.969101 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04794bcb-24cd-4eb0-b37c-92f99db1bdb2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:13.969538 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04794bcb-24cd-4eb0-b37c-92f99db1bdb2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:13.979048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-e3200be3-a4c2-4729-8473-83c6fbb05f55 req-b30fd89a-85f8-45ee-8166-0dc2956d9891 service nova] Creating event network-changed:aaff41ef-ea9c-4fbb-aca7-6e83376b98f6 for instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 on hv-cinder-79053 Jun 04 18:43:13.986338 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-e3200be3-a4c2-4729-8473-83c6fbb05f55 req-b30fd89a-85f8-45ee-8166-0dc2956d9891 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037969 Jun 04 18:43:13.987317 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 517/1022] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:43:13.993962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-35a51812-2567-4f00-b741-46f37af44d14 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:13.995514 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-35a51812-2567-4f00-b741-46f37af44d14 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:13.997855 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-04794bcb-24cd-4eb0-b37c-92f99db1bdb2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:43:14.004876 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35a51812-2567-4f00-b741-46f37af44d14 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:14.005988 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35a51812-2567-4f00-b741-46f37af44d14 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:14.007276 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35a51812-2567-4f00-b741-46f37af44d14 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:14.007865 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35a51812-2567-4f00-b741-46f37af44d14 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:14.055341 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:14.123144 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-04794bcb-24cd-4eb0-b37c-92f99db1bdb2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 204 len: 0 microversion: 2.1 time: 0.179259 Jun 04 18:43:14.127135 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 506/1023] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:43:13 2022] DELETE /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 18:43:14.136278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e2157785-152a-4bbb-9ea8-0d5f17fe6bf8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:14.137160 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e2157785-152a-4bbb-9ea8-0d5f17fe6bf8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:14.146205 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2157785-152a-4bbb-9ea8-0d5f17fe6bf8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:14.146782 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2157785-152a-4bbb-9ea8-0d5f17fe6bf8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:14.147816 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2157785-152a-4bbb-9ea8-0d5f17fe6bf8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:14.149083 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2157785-152a-4bbb-9ea8-0d5f17fe6bf8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:14.302854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-35a51812-2567-4f00-b741-46f37af44d14 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "POST /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5/action" status: 202 len: 0 microversion: 2.1 time: 0.308048 Jun 04 18:43:14.303551 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 518/1024] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 4 18:43:13 2022] POST /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:43:14.310131 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e2157785-152a-4bbb-9ea8-0d5f17fe6bf8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:14.312630 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cbe82214-fbe3-4952-8fe5-a1c7a2270c8d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:14.318048 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e2157785-152a-4bbb-9ea8-0d5f17fe6bf8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1578 microversion: 2.1 time: 0.189246 Jun 04 18:43:14.318204 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cbe82214-fbe3-4952-8fe5-a1c7a2270c8d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:14.319044 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 507/1025] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:14 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:14.332752 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbe82214-fbe3-4952-8fe5-a1c7a2270c8d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:14.333284 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbe82214-fbe3-4952-8fe5-a1c7a2270c8d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:14.334254 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbe82214-fbe3-4952-8fe5-a1c7a2270c8d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:14.334717 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbe82214-fbe3-4952-8fe5-a1c7a2270c8d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:14.491003 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cbe82214-fbe3-4952-8fe5-a1c7a2270c8d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:14.494449 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:14.503318 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cbe82214-fbe3-4952-8fe5-a1c7a2270c8d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.194254 Jun 04 18:43:14.504028 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 519/1026] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:14 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:14.709675 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:14.710267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:14.717193 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:14.717638 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:14.718411 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:14.718854 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:14.852119 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:14.860170 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:14.861755 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:14.863086 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c844a047-9751-473b-a1f7-2b146b71d607 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.157881 Jun 04 18:43:14.863654 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 508/1027] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:14 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:15.337215 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0f9b4b22-0a47-4203-b052-36c825d4e791 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:15.337809 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0f9b4b22-0a47-4203-b052-36c825d4e791 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:15.345718 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f9b4b22-0a47-4203-b052-36c825d4e791 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:15.346405 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f9b4b22-0a47-4203-b052-36c825d4e791 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:15.347370 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f9b4b22-0a47-4203-b052-36c825d4e791 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:15.347831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f9b4b22-0a47-4203-b052-36c825d4e791 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:15.491280 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0f9b4b22-0a47-4203-b052-36c825d4e791 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:15.499099 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0f9b4b22-0a47-4203-b052-36c825d4e791 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1578 microversion: 2.1 time: 0.166082 Jun 04 18:43:15.499634 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 520/1028] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:15 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:15.520978 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-80951ead-b454-4847-850a-a3e58b34742b tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:15.521659 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-80951ead-b454-4847-850a-a3e58b34742b tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:15.528296 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-80951ead-b454-4847-850a-a3e58b34742b tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:15.529153 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-80951ead-b454-4847-850a-a3e58b34742b tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:15.529565 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-80951ead-b454-4847-850a-a3e58b34742b tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:15.530090 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-80951ead-b454-4847-850a-a3e58b34742b tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:15.671451 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-80951ead-b454-4847-850a-a3e58b34742b tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:15.680137 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-80951ead-b454-4847-850a-a3e58b34742b tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.162961 Jun 04 18:43:15.680744 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 509/1029] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:15 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:15.882032 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:15.882477 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:15.889608 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:15.890058 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:15.890845 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:15.891265 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:16.070817 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:16.082625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:16.085055 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:16.086428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3846541d-49e5-4de7-896e-55b2a0dca751 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.208659 Jun 04 18:43:16.100502 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 521/1030] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:15 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:16.395485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-d610bf99-6559-4501-b363-4818501a0b7f req-126da04d-094d-47fe-9585-cc22005199ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ab534c-de63-4e2e-84a4-ed1072d868d5", "name": "network-vif-unplugged", "status": "completed", "tag": "35ec7e5f-d6aa-48ed-bcce-e38d546401a3"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:16.414116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d610bf99-6559-4501-b363-4818501a0b7f req-126da04d-094d-47fe-9585-cc22005199ac service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:16.422668 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d610bf99-6559-4501-b363-4818501a0b7f req-126da04d-094d-47fe-9585-cc22005199ac service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:16.468242 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.compute.server_external_events [req-d610bf99-6559-4501-b363-4818501a0b7f req-126da04d-094d-47fe-9585-cc22005199ac service nova] Unable to find a host for instance e2ab534c-de63-4e2e-84a4-ed1072d868d5. Dropping event network-vif-unplugged {{(pid=117731) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 18:43:16.471450 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-d610bf99-6559-4501-b363-4818501a0b7f req-126da04d-094d-47fe-9585-cc22005199ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.078977 Jun 04 18:43:16.472726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 510/1031] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 83 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 04 18:43:16.488051 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-b121f347-bd85-4c73-b4c4-43f88a4c793b req-100ab708-0d2e-44bf-b166-ed9d47c7d66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d75266f-49ff-434a-aedf-33ee2c9aa1f6", "name": "network-vif-deleted", "tag": "aaff41ef-ea9c-4fbb-aca7-6e83376b98f6"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:16.498722 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b121f347-bd85-4c73-b4c4-43f88a4c793b req-100ab708-0d2e-44bf-b166-ed9d47c7d66c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:16.500079 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b121f347-bd85-4c73-b4c4-43f88a4c793b req-100ab708-0d2e-44bf-b166-ed9d47c7d66c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:16.515620 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4f02bf74-74a0-4a9f-bd60-402ed7ca21bc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:16.516837 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4f02bf74-74a0-4a9f-bd60-402ed7ca21bc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:16.522569 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-b121f347-bd85-4c73-b4c4-43f88a4c793b req-100ab708-0d2e-44bf-b166-ed9d47c7d66c service nova] Creating event network-vif-deleted:aaff41ef-ea9c-4fbb-aca7-6e83376b98f6 for instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 on hv-cinder-79053 Jun 04 18:43:16.526384 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f02bf74-74a0-4a9f-bd60-402ed7ca21bc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:16.530623 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f02bf74-74a0-4a9f-bd60-402ed7ca21bc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:16.532499 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f02bf74-74a0-4a9f-bd60-402ed7ca21bc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:16.533591 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f02bf74-74a0-4a9f-bd60-402ed7ca21bc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:16.539492 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-b121f347-bd85-4c73-b4c4-43f88a4c793b req-100ab708-0d2e-44bf-b166-ed9d47c7d66c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055592 Jun 04 18:43:16.540786 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 522/1032] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:43:16.661404 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4f02bf74-74a0-4a9f-bd60-402ed7ca21bc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:16.672883 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4f02bf74-74a0-4a9f-bd60-402ed7ca21bc tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.160808 Jun 04 18:43:16.673588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 511/1033] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:16 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:43:16.698915 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5ff11f7a-8abe-4f80-8920-d48c3cd2237f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:16.699940 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5ff11f7a-8abe-4f80-8920-d48c3cd2237f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:16.708521 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ff11f7a-8abe-4f80-8920-d48c3cd2237f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:16.709966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ff11f7a-8abe-4f80-8920-d48c3cd2237f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:16.710945 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ff11f7a-8abe-4f80-8920-d48c3cd2237f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:16.711542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ff11f7a-8abe-4f80-8920-d48c3cd2237f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:16.916936 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5ff11f7a-8abe-4f80-8920-d48c3cd2237f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:16.932754 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5ff11f7a-8abe-4f80-8920-d48c3cd2237f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.238485 Jun 04 18:43:16.933336 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 523/1034] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:16 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:17.107486 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:17.108034 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:17.115584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:17.116053 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:17.116831 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:17.117398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:17.278934 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:17.288237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:17.289840 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:17.291130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3b776e75-4ed9-432c-9cd5-31e19c27969d tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.188129 Jun 04 18:43:17.291786 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 512/1035] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:17 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:17.690243 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fe2e3f95-d092-4909-aa49-3e0cbcc7fcfa tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:17.690906 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fe2e3f95-d092-4909-aa49-3e0cbcc7fcfa tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:17.697536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe2e3f95-d092-4909-aa49-3e0cbcc7fcfa tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:17.697986 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe2e3f95-d092-4909-aa49-3e0cbcc7fcfa tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:17.698748 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe2e3f95-d092-4909-aa49-3e0cbcc7fcfa tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:17.699182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe2e3f95-d092-4909-aa49-3e0cbcc7fcfa tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:17.774900 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe2e3f95-d092-4909-aa49-3e0cbcc7fcfa tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:17.782948 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fe2e3f95-d092-4909-aa49-3e0cbcc7fcfa tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.096637 Jun 04 18:43:17.783519 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 524/1036] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:17 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:17.951569 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-41d36c0e-465c-45b1-bb74-cfea14bae63c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:17.952240 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-41d36c0e-465c-45b1-bb74-cfea14bae63c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:17.962101 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-41d36c0e-465c-45b1-bb74-cfea14bae63c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:17.962559 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-41d36c0e-465c-45b1-bb74-cfea14bae63c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:17.963731 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-41d36c0e-465c-45b1-bb74-cfea14bae63c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:17.964259 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-41d36c0e-465c-45b1-bb74-cfea14bae63c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:18.109443 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-41d36c0e-465c-45b1-bb74-cfea14bae63c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:18.118094 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-41d36c0e-465c-45b1-bb74-cfea14bae63c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.170707 Jun 04 18:43:18.128806 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 513/1037] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:17 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:18.311461 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:18.312286 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:18.318955 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:18.319393 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:18.320213 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:18.320652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:18.459555 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:18.468692 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:18.470530 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:18.471903 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0c220a05-8ac8-4d43-92ea-5f7247401ce5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.164621 Jun 04 18:43:18.482881 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 525/1038] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:18 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:18.800577 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c359d48d-cfa8-4a38-89a7-a5014ae4b763 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:18.801198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c359d48d-cfa8-4a38-89a7-a5014ae4b763 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:18.807639 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c359d48d-cfa8-4a38-89a7-a5014ae4b763 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:18.808114 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c359d48d-cfa8-4a38-89a7-a5014ae4b763 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:18.808892 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c359d48d-cfa8-4a38-89a7-a5014ae4b763 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:18.809673 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c359d48d-cfa8-4a38-89a7-a5014ae4b763 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:18.880100 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c359d48d-cfa8-4a38-89a7-a5014ae4b763 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:18.900652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c359d48d-cfa8-4a38-89a7-a5014ae4b763 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.103390 Jun 04 18:43:18.913671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 514/1039] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:18 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:19.135896 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8f4a379c-1c01-4a9b-baf7-02a864c7b0c6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:19.136485 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8f4a379c-1c01-4a9b-baf7-02a864c7b0c6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:19.143478 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8f4a379c-1c01-4a9b-baf7-02a864c7b0c6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:19.143930 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8f4a379c-1c01-4a9b-baf7-02a864c7b0c6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:19.144853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8f4a379c-1c01-4a9b-baf7-02a864c7b0c6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:19.145293 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8f4a379c-1c01-4a9b-baf7-02a864c7b0c6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:19.288638 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8f4a379c-1c01-4a9b-baf7-02a864c7b0c6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:19.307509 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8f4a379c-1c01-4a9b-baf7-02a864c7b0c6 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.175128 Jun 04 18:43:19.308128 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 526/1040] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:19 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:19.491196 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:19.492576 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:19.499378 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:19.500198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:19.501054 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:19.501758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:19.648477 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:19.656726 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:19.658736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:19.659917 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-780c85b6-733c-4a16-b832-8294c87307eb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.172998 Jun 04 18:43:19.670933 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 515/1041] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:19 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:19.922415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1c0822d0-0f18-4074-aa8b-d68ae764805d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:19.923328 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1c0822d0-0f18-4074-aa8b-d68ae764805d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:19.930666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c0822d0-0f18-4074-aa8b-d68ae764805d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:19.931188 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c0822d0-0f18-4074-aa8b-d68ae764805d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:19.932253 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c0822d0-0f18-4074-aa8b-d68ae764805d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:19.932736 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1c0822d0-0f18-4074-aa8b-d68ae764805d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:20.005348 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1c0822d0-0f18-4074-aa8b-d68ae764805d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:20.014718 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1c0822d0-0f18-4074-aa8b-d68ae764805d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.098059 Jun 04 18:43:20.016056 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 527/1042] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:19 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:20.325285 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3bb04049-8071-49ad-915e-d84c6b57cef7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:20.326170 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3bb04049-8071-49ad-915e-d84c6b57cef7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:20.334579 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bb04049-8071-49ad-915e-d84c6b57cef7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:20.335204 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bb04049-8071-49ad-915e-d84c6b57cef7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:20.336113 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bb04049-8071-49ad-915e-d84c6b57cef7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:20.336720 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bb04049-8071-49ad-915e-d84c6b57cef7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:20.475564 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3bb04049-8071-49ad-915e-d84c6b57cef7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:20.487020 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3bb04049-8071-49ad-915e-d84c6b57cef7 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.166420 Jun 04 18:43:20.487587 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 516/1043] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:20 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:20.680559 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:20.681422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:20.689448 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:20.690257 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:20.691160 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:20.691704 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:20.832045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:20.840562 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:20.842066 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:20.843232 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-01ca2a26-4a94-49dd-8979-84aaa0b10765 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.168043 Jun 04 18:43:20.843794 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 528/1044] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:20 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:21.032452 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5dec0bb3-86c3-40e5-8a9a-f6d3e1517100 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:21.033065 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5dec0bb3-86c3-40e5-8a9a-f6d3e1517100 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:21.039757 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5dec0bb3-86c3-40e5-8a9a-f6d3e1517100 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:21.040246 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5dec0bb3-86c3-40e5-8a9a-f6d3e1517100 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:21.041017 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5dec0bb3-86c3-40e5-8a9a-f6d3e1517100 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:21.041415 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5dec0bb3-86c3-40e5-8a9a-f6d3e1517100 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:21.119737 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5dec0bb3-86c3-40e5-8a9a-f6d3e1517100 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:21.128468 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5dec0bb3-86c3-40e5-8a9a-f6d3e1517100 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.100276 Jun 04 18:43:21.129032 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 517/1045] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:21 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:21.504939 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-10b521f3-1505-4c9e-aeb1-5fd3e42afe21 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:21.505550 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-10b521f3-1505-4c9e-aeb1-5fd3e42afe21 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:21.511751 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10b521f3-1505-4c9e-aeb1-5fd3e42afe21 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:21.512171 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10b521f3-1505-4c9e-aeb1-5fd3e42afe21 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:21.512978 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10b521f3-1505-4c9e-aeb1-5fd3e42afe21 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:21.513421 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10b521f3-1505-4c9e-aeb1-5fd3e42afe21 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:21.664458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-10b521f3-1505-4c9e-aeb1-5fd3e42afe21 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:21.673119 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-10b521f3-1505-4c9e-aeb1-5fd3e42afe21 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.171972 Jun 04 18:43:21.682795 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 529/1046] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:21 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:21.863517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:21.864166 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:21.871553 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:21.872026 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:21.873010 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:21.873460 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:22.018539 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:22.026863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:22.028396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:22.029646 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-79438e5d-2ead-4063-9916-47c08255564e tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.171474 Jun 04 18:43:22.030213 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 518/1047] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:21 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:22.147204 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b7c18662-554b-4308-9308-b9da96a6495e tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:22.148165 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b7c18662-554b-4308-9308-b9da96a6495e tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:22.156303 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b7c18662-554b-4308-9308-b9da96a6495e tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:22.156856 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b7c18662-554b-4308-9308-b9da96a6495e tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:22.158310 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b7c18662-554b-4308-9308-b9da96a6495e tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:22.158959 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b7c18662-554b-4308-9308-b9da96a6495e tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:22.224961 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b7c18662-554b-4308-9308-b9da96a6495e tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:22.235420 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b7c18662-554b-4308-9308-b9da96a6495e tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.092503 Jun 04 18:43:22.240666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 530/1048] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:22 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:22.690775 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dadf4642-1316-4b56-b97a-c82a5074b099 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:22.691382 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dadf4642-1316-4b56-b97a-c82a5074b099 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:22.697689 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dadf4642-1316-4b56-b97a-c82a5074b099 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:22.698143 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dadf4642-1316-4b56-b97a-c82a5074b099 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:22.698943 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dadf4642-1316-4b56-b97a-c82a5074b099 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:22.699373 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dadf4642-1316-4b56-b97a-c82a5074b099 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:22.853263 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dadf4642-1316-4b56-b97a-c82a5074b099 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:22.862574 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dadf4642-1316-4b56-b97a-c82a5074b099 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.175675 Jun 04 18:43:22.863582 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 519/1049] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:22 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:23.048369 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:23.050451 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:23.055606 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:23.056091 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:23.056874 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:23.057352 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:23.201106 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:23.209497 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:23.211009 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:23.212229 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c0841afd-6fd8-4866-8925-f33fe37664a4 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.167953 Jun 04 18:43:23.212795 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 531/1050] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:23 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:23.250714 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02e0d96d-268f-4cd9-8c72-53548239f730 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:23.251353 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02e0d96d-268f-4cd9-8c72-53548239f730 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:23.258650 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e0d96d-268f-4cd9-8c72-53548239f730 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:23.259365 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e0d96d-268f-4cd9-8c72-53548239f730 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:23.260363 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e0d96d-268f-4cd9-8c72-53548239f730 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:23.260954 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e0d96d-268f-4cd9-8c72-53548239f730 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:23.331172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02e0d96d-268f-4cd9-8c72-53548239f730 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:23.340367 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02e0d96d-268f-4cd9-8c72-53548239f730 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.093547 Jun 04 18:43:23.340960 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 520/1051] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:23 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:23.884691 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-51b35759-f559-46be-818a-e86598391cb1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:23.885547 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-51b35759-f559-46be-818a-e86598391cb1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:23.896213 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51b35759-f559-46be-818a-e86598391cb1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:23.896964 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51b35759-f559-46be-818a-e86598391cb1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:23.898214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51b35759-f559-46be-818a-e86598391cb1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:23.898932 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51b35759-f559-46be-818a-e86598391cb1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:24.038541 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-51b35759-f559-46be-818a-e86598391cb1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:24.050025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-51b35759-f559-46be-818a-e86598391cb1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.172505 Jun 04 18:43:24.050646 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 532/1052] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:23 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:24.235947 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:24.236987 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:24.244369 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:24.244822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:24.245589 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:24.246024 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:24.358459 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1f59501a-676e-48a4-8373-3073e311cb51 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:24.359093 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1f59501a-676e-48a4-8373-3073e311cb51 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:24.366417 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f59501a-676e-48a4-8373-3073e311cb51 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:24.366876 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f59501a-676e-48a4-8373-3073e311cb51 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:24.367652 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f59501a-676e-48a4-8373-3073e311cb51 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:24.368128 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f59501a-676e-48a4-8373-3073e311cb51 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:24.385409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:24.393920 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:24.396200 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:24.397473 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5b41256f-5abc-4f00-9109-51058d79abd0 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.168110 Jun 04 18:43:24.398099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 521/1053] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:24 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:24.432315 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1f59501a-676e-48a4-8373-3073e311cb51 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:24.440047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1f59501a-676e-48a4-8373-3073e311cb51 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.085523 Jun 04 18:43:24.440808 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 533/1054] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:24 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:25.071117 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1c4146db-15b1-4cc3-8819-ae0c4ad16752 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:25.071725 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1c4146db-15b1-4cc3-8819-ae0c4ad16752 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:25.078179 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1c4146db-15b1-4cc3-8819-ae0c4ad16752 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:25.078625 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1c4146db-15b1-4cc3-8819-ae0c4ad16752 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:25.079416 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1c4146db-15b1-4cc3-8819-ae0c4ad16752 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:25.079878 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1c4146db-15b1-4cc3-8819-ae0c4ad16752 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:25.220822 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1c4146db-15b1-4cc3-8819-ae0c4ad16752 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:25.228723 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1c4146db-15b1-4cc3-8819-ae0c4ad16752 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.161541 Jun 04 18:43:25.229277 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 522/1055] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:25 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:25.418114 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:25.418707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:25.425906 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:25.426354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:25.427122 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:25.427639 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:25.458348 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fd9639b2-df80-4074-95da-f2b0363f7f13 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:25.458902 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fd9639b2-df80-4074-95da-f2b0363f7f13 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:25.465587 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd9639b2-df80-4074-95da-f2b0363f7f13 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:25.466035 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd9639b2-df80-4074-95da-f2b0363f7f13 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:25.466798 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd9639b2-df80-4074-95da-f2b0363f7f13 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:25.467223 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd9639b2-df80-4074-95da-f2b0363f7f13 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:25.485819 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:25.534616 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fd9639b2-df80-4074-95da-f2b0363f7f13 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:25.542741 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fd9639b2-df80-4074-95da-f2b0363f7f13 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.088950 Jun 04 18:43:25.543314 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 523/1056] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:25 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:25.577147 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:25.585974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:25.587460 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:25.588772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9ab981be-f867-45e9-bc98-42f8a156e142 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.175083 Jun 04 18:43:25.589337 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 534/1057] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:25 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:26.247519 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-760cefd8-1fee-49a3-b065-b27fb21c1250 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:26.248242 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-760cefd8-1fee-49a3-b065-b27fb21c1250 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:26.256500 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-760cefd8-1fee-49a3-b065-b27fb21c1250 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:26.256948 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-760cefd8-1fee-49a3-b065-b27fb21c1250 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:26.257710 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-760cefd8-1fee-49a3-b065-b27fb21c1250 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:26.258144 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-760cefd8-1fee-49a3-b065-b27fb21c1250 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:26.406592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-760cefd8-1fee-49a3-b065-b27fb21c1250 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:26.417741 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-760cefd8-1fee-49a3-b065-b27fb21c1250 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.174110 Jun 04 18:43:26.418329 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 524/1058] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:26 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:26.563432 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d0fd89c7-963e-4089-92fc-b7102473770b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:26.564026 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d0fd89c7-963e-4089-92fc-b7102473770b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:26.571688 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0fd89c7-963e-4089-92fc-b7102473770b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:26.572178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0fd89c7-963e-4089-92fc-b7102473770b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:26.572953 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0fd89c7-963e-4089-92fc-b7102473770b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:26.573395 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0fd89c7-963e-4089-92fc-b7102473770b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:26.612477 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:26.613183 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:26.621338 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:26.621784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:26.622563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:26.622991 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:26.645260 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d0fd89c7-963e-4089-92fc-b7102473770b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:26.653091 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d0fd89c7-963e-4089-92fc-b7102473770b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.096076 Jun 04 18:43:26.653665 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 535/1059] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:26 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:26.758748 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:26.769125 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:26.770660 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:26.771831 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d00aa4a2-d252-4270-a42a-57c86d4c99fb tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.163284 Jun 04 18:43:26.772431 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 525/1060] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:26 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:27.444525 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-718cf6fb-6c36-423f-9a43-d686710f186f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:27.445281 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-718cf6fb-6c36-423f-9a43-d686710f186f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:27.453128 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-718cf6fb-6c36-423f-9a43-d686710f186f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:27.453686 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-718cf6fb-6c36-423f-9a43-d686710f186f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:27.454635 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-718cf6fb-6c36-423f-9a43-d686710f186f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:27.455232 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-718cf6fb-6c36-423f-9a43-d686710f186f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:27.589303 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-718cf6fb-6c36-423f-9a43-d686710f186f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:27.598142 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-718cf6fb-6c36-423f-9a43-d686710f186f tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1514 microversion: 2.1 time: 0.158806 Jun 04 18:43:27.598716 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 536/1061] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:27 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:27.674657 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-60252688-e209-4116-b3d5-ce12f67af683 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:27.676054 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-60252688-e209-4116-b3d5-ce12f67af683 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:27.683040 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-60252688-e209-4116-b3d5-ce12f67af683 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:27.683485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-60252688-e209-4116-b3d5-ce12f67af683 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:27.684298 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-60252688-e209-4116-b3d5-ce12f67af683 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:27.684735 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-60252688-e209-4116-b3d5-ce12f67af683 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:27.757563 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-60252688-e209-4116-b3d5-ce12f67af683 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:27.765354 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-60252688-e209-4116-b3d5-ce12f67af683 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1391 microversion: 2.1 time: 0.097201 Jun 04 18:43:27.765919 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 526/1062] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:27 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1391 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:27.790702 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:27.791528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:27.798035 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:27.798489 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:27.799253 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:27.799690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:27.802710 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:27.943324 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:27.955410 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:27.957605 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:27.958765 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a09db775-2b93-4a04-8a42-779881929a4a tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.172036 Jun 04 18:43:27.959332 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 537/1063] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:27 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:28.619806 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-46bed9ba-6521-482a-88d1-c6e6b91f8c8c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:28.620804 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-46bed9ba-6521-482a-88d1-c6e6b91f8c8c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:28.631219 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46bed9ba-6521-482a-88d1-c6e6b91f8c8c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:28.631961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46bed9ba-6521-482a-88d1-c6e6b91f8c8c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:28.633263 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46bed9ba-6521-482a-88d1-c6e6b91f8c8c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:28.633976 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46bed9ba-6521-482a-88d1-c6e6b91f8c8c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:28.773383 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-46bed9ba-6521-482a-88d1-c6e6b91f8c8c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:28.781343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-46bed9ba-6521-482a-88d1-c6e6b91f8c8c tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1516 microversion: 2.1 time: 0.168453 Jun 04 18:43:28.781913 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 527/1064] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:28 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:28.782506 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bddeccc9-f7f2-4b63-84b9-907ae378fc53 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:28.783122 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bddeccc9-f7f2-4b63-84b9-907ae378fc53 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:28.790380 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bddeccc9-f7f2-4b63-84b9-907ae378fc53 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:28.790843 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bddeccc9-f7f2-4b63-84b9-907ae378fc53 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:28.791641 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bddeccc9-f7f2-4b63-84b9-907ae378fc53 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:28.792111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bddeccc9-f7f2-4b63-84b9-907ae378fc53 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:28.866317 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bddeccc9-f7f2-4b63-84b9-907ae378fc53 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:28.874513 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bddeccc9-f7f2-4b63-84b9-907ae378fc53 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1224 microversion: 2.1 time: 0.095769 Jun 04 18:43:28.875013 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 538/1065] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:28 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:43:28.979658 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:28.980320 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:28.988775 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:28.989121 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:28.989956 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:28.990438 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:29.158218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:29.167712 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:29.169398 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:29.170582 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-37817691-f2af-46e1-aace-92739a764498 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.195808 Jun 04 18:43:29.171186 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 528/1066] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:28 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:43:29.803206 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e230d0b8-5134-45ac-81d9-432a999c3c93 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:29.804121 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e230d0b8-5134-45ac-81d9-432a999c3c93 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:29.815318 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e230d0b8-5134-45ac-81d9-432a999c3c93 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:29.816313 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e230d0b8-5134-45ac-81d9-432a999c3c93 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:29.817091 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e230d0b8-5134-45ac-81d9-432a999c3c93 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:29.817536 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e230d0b8-5134-45ac-81d9-432a999c3c93 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:29.891581 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a32ff9c0-dc7c-430d-a483-9d9423b62f2c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:29.892188 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a32ff9c0-dc7c-430d-a483-9d9423b62f2c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:29.899159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a32ff9c0-dc7c-430d-a483-9d9423b62f2c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:29.899614 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a32ff9c0-dc7c-430d-a483-9d9423b62f2c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:29.900429 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a32ff9c0-dc7c-430d-a483-9d9423b62f2c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:29.900868 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a32ff9c0-dc7c-430d-a483-9d9423b62f2c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:29.950279 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e230d0b8-5134-45ac-81d9-432a999c3c93 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:29.958059 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e230d0b8-5134-45ac-81d9-432a999c3c93 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1516 microversion: 2.1 time: 0.161665 Jun 04 18:43:29.958633 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 539/1067] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:29 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:29.970579 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a32ff9c0-dc7c-430d-a483-9d9423b62f2c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:29.979108 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a32ff9c0-dc7c-430d-a483-9d9423b62f2c tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 200 len: 1224 microversion: 2.1 time: 0.091545 Jun 04 18:43:29.979672 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 529/1068] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:29 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:30.190915 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:30.191711 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:30.199963 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:30.200582 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:30.201690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:30.202095 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:30.355627 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:30.364671 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:30.366201 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:30.367357 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0c66ab77-b2d5-4f59-8f4e-e99589373ded tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.181444 Jun 04 18:43:30.367933 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 540/1069] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:30 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:30.975982 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-130ea5e6-f6e0-4a5d-b49a-1ce7053efc49 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:30.976618 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-130ea5e6-f6e0-4a5d-b49a-1ce7053efc49 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:30.984057 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-130ea5e6-f6e0-4a5d-b49a-1ce7053efc49 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:30.984556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-130ea5e6-f6e0-4a5d-b49a-1ce7053efc49 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:30.985375 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-130ea5e6-f6e0-4a5d-b49a-1ce7053efc49 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:30.985834 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-130ea5e6-f6e0-4a5d-b49a-1ce7053efc49 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:30.999629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:31.000307 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: 0d75266f-49ff-434a-aedf-33ee2c9aa1f6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:31.007422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:31.007861 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:31.008700 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:31.009139 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:31.022927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] HTTP exception thrown: Instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 could not be found. Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Request method failure captured: Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 HTTP/1.1 Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6WxdfSUl0tipBd3mtfxBqzOQ7RaxEa1Kt3hnaIVE-cssElfw3iwz56KTq3Fp-PxoMoEvY9i5mTlerhn4BmF6kl2IPjyDgwXCKduFwAvVMWbkHtYD_bUoREJY32lwaPezxWNU5MCmrlqAQ1RSEzuDCSmwujTol_xEQ6K8l5YUc0hXUw Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:43:31.024542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}] Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: cf94c76ba04b403b91a7ff77a2f476e8 Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 could not be found. Jun 04 18:43:31.026238 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '0d75266f-49ff-434a-aedf-33ee2c9aa1f6'} Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 could not be found. Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:43:31.027148 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 could not be found. Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 could not be found. Jun 04 18:43:31.028678 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:31.030025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Returning 404 to user: Instance 0d75266f-49ff-434a-aedf-33ee2c9aa1f6 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:43:31.030025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bde87aea-df3e-4c6c-89da-ebd4da67569a tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6" status: 404 len: 111 microversion: 2.1 time: 0.030551 Jun 04 18:43:31.030025 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 541/1070] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:30 2022] GET /compute/v2.1/servers/0d75266f-49ff-434a-aedf-33ee2c9aa1f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:43:31.135449 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-130ea5e6-f6e0-4a5d-b49a-1ce7053efc49 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:31.143268 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-130ea5e6-f6e0-4a5d-b49a-1ce7053efc49 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.172078 Jun 04 18:43:31.143834 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 530/1071] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:30 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:31.386657 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:31.387263 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:31.394984 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:31.395437 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:31.396253 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:31.396685 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:31.534068 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:31.547567 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:31.550023 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:31.552251 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d0056885-eb9d-4911-806d-fe1cff9b8f35 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.169196 Jun 04 18:43:31.552815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 542/1072] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:31 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:32.163996 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3ac6d173-7fa7-464d-8f81-530d76b006a2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:32.164632 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3ac6d173-7fa7-464d-8f81-530d76b006a2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:32.172041 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ac6d173-7fa7-464d-8f81-530d76b006a2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:32.172528 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ac6d173-7fa7-464d-8f81-530d76b006a2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:32.173291 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ac6d173-7fa7-464d-8f81-530d76b006a2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:32.173800 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ac6d173-7fa7-464d-8f81-530d76b006a2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:32.319325 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3ac6d173-7fa7-464d-8f81-530d76b006a2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:32.327464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3ac6d173-7fa7-464d-8f81-530d76b006a2 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.169622 Jun 04 18:43:32.328038 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 531/1073] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:32 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:32.571059 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:32.571640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:32.578649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:32.579110 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:32.580055 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:32.580499 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:32.720964 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:32.729821 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:32.731321 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:32.732512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-026470d3-75e4-49bc-bb63-526d3f10b866 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.165617 Jun 04 18:43:32.733083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 543/1074] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:32 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:33.344605 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e3253e94-684d-4717-a24c-bb195b732e5e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:33.345214 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e3253e94-684d-4717-a24c-bb195b732e5e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:33.352034 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e3253e94-684d-4717-a24c-bb195b732e5e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:33.352464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e3253e94-684d-4717-a24c-bb195b732e5e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:33.353666 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e3253e94-684d-4717-a24c-bb195b732e5e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:33.355134 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e3253e94-684d-4717-a24c-bb195b732e5e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:33.493063 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e3253e94-684d-4717-a24c-bb195b732e5e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:33.500861 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e3253e94-684d-4717-a24c-bb195b732e5e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.160224 Jun 04 18:43:33.501437 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 532/1075] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:33 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:33.751188 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:33.751827 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:33.759138 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:33.759597 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:33.760415 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:33.760854 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:33.967630 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:33.976523 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:33.978128 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:33.979282 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b69497b8-8473-4f4b-9102-8b6bf368d0e8 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.232337 Jun 04 18:43:33.979866 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 544/1076] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:33 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:34.229868 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-80117968-4006-44a6-8a10-eab953b54c7b req-8df9624f-b8bf-4fa0-91b5-a78a6b17b9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf23d455-c4ee-41bb-b074-7a2e399fd8c0", "tag": "9892af68-c3a6-4862-855b-ea6a4e9a33c2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:34.233020 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0e568f45-c96e-42cd-adff-4aed481c7f98 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:34.233995 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0e568f45-c96e-42cd-adff-4aed481c7f98 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:34.243020 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-80117968-4006-44a6-8a10-eab953b54c7b req-8df9624f-b8bf-4fa0-91b5-a78a6b17b9b1 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:34.243460 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-80117968-4006-44a6-8a10-eab953b54c7b req-8df9624f-b8bf-4fa0-91b5-a78a6b17b9b1 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:34.249119 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e568f45-c96e-42cd-adff-4aed481c7f98 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:34.249652 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e568f45-c96e-42cd-adff-4aed481c7f98 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:34.251117 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e568f45-c96e-42cd-adff-4aed481c7f98 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:34.252974 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e568f45-c96e-42cd-adff-4aed481c7f98 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:34.267087 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-80117968-4006-44a6-8a10-eab953b54c7b req-8df9624f-b8bf-4fa0-91b5-a78a6b17b9b1 service nova] Creating event network-changed:9892af68-c3a6-4862-855b-ea6a4e9a33c2 for instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 on hv-cinder-79053 Jun 04 18:43:34.274352 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-80117968-4006-44a6-8a10-eab953b54c7b req-8df9624f-b8bf-4fa0-91b5-a78a6b17b9b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047562 Jun 04 18:43:34.275741 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 545/1077] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:43:34.296647 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0e568f45-c96e-42cd-adff-4aed481c7f98 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:43:34.421496 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0e568f45-c96e-42cd-adff-4aed481c7f98 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 204 len: 0 microversion: 2.1 time: 0.200829 Jun 04 18:43:34.423366 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 533/1078] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:43:34 2022] DELETE /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:43:34.432827 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1412c177-c45c-4b75-a9b8-b782760c9fc2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:34.433560 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1412c177-c45c-4b75-a9b8-b782760c9fc2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:34.440968 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1412c177-c45c-4b75-a9b8-b782760c9fc2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:34.441424 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1412c177-c45c-4b75-a9b8-b782760c9fc2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:34.442897 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1412c177-c45c-4b75-a9b8-b782760c9fc2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:34.443338 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1412c177-c45c-4b75-a9b8-b782760c9fc2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:34.471238 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-f38ef934-6027-44e0-a71f-087099c64167 req-434f991a-1434-499b-83a3-8dd666856959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02795c57-88a4-46ac-be72-8c43dc178e4f", "name": "network-vif-plugged", "status": "completed", "tag": "0e876440-c9c1-4ed0-be90-0af7d5fd38fe"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:34.479799 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f38ef934-6027-44e0-a71f-087099c64167 req-434f991a-1434-499b-83a3-8dd666856959 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:34.480465 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f38ef934-6027-44e0-a71f-087099c64167 req-434f991a-1434-499b-83a3-8dd666856959 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:34.493603 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-f38ef934-6027-44e0-a71f-087099c64167 req-434f991a-1434-499b-83a3-8dd666856959 service nova] Creating event network-vif-plugged:0e876440-c9c1-4ed0-be90-0af7d5fd38fe for instance 02795c57-88a4-46ac-be72-8c43dc178e4f on hv-cinder-79053 Jun 04 18:43:34.498904 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-f38ef934-6027-44e0-a71f-087099c64167 req-434f991a-1434-499b-83a3-8dd666856959 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032071 Jun 04 18:43:34.499782 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 534/1079] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:43:34.521000 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6a2a2074-f4cc-4345-85a9-cbebee8d49da tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:34.521864 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6a2a2074-f4cc-4345-85a9-cbebee8d49da tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:34.528967 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6a2a2074-f4cc-4345-85a9-cbebee8d49da tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:34.529429 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6a2a2074-f4cc-4345-85a9-cbebee8d49da tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:34.530210 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6a2a2074-f4cc-4345-85a9-cbebee8d49da tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:34.531127 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6a2a2074-f4cc-4345-85a9-cbebee8d49da tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:34.634695 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1412c177-c45c-4b75-a9b8-b782760c9fc2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:34.647878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1412c177-c45c-4b75-a9b8-b782760c9fc2 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1577 microversion: 2.1 time: 0.219921 Jun 04 18:43:34.649099 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 546/1080] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:34 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:34.765408 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6a2a2074-f4cc-4345-85a9-cbebee8d49da tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:34.773229 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6a2a2074-f4cc-4345-85a9-cbebee8d49da tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.256833 Jun 04 18:43:34.773835 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 535/1081] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:34 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:35.006134 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:35.006816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:35.013920 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:35.014364 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:35.015128 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:35.015553 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:35.156604 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:35.165492 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:35.167011 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:35.168235 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-52337478-df44-4400-8cbc-701f87a8a9c5 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.166226 Jun 04 18:43:35.168779 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 547/1082] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:35 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:35.666788 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f33f451c-ccd4-4880-b8f1-e2af368c212d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:35.667403 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f33f451c-ccd4-4880-b8f1-e2af368c212d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:35.674914 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f33f451c-ccd4-4880-b8f1-e2af368c212d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:35.675360 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f33f451c-ccd4-4880-b8f1-e2af368c212d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:35.676220 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f33f451c-ccd4-4880-b8f1-e2af368c212d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:35.676956 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f33f451c-ccd4-4880-b8f1-e2af368c212d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:35.790885 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a9b3b515-4550-42a4-9e4e-50a1adf53731 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:35.791619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a9b3b515-4550-42a4-9e4e-50a1adf53731 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:35.799044 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9b3b515-4550-42a4-9e4e-50a1adf53731 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:35.799583 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9b3b515-4550-42a4-9e4e-50a1adf53731 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:35.800461 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9b3b515-4550-42a4-9e4e-50a1adf53731 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:35.801005 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9b3b515-4550-42a4-9e4e-50a1adf53731 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:35.823774 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f33f451c-ccd4-4880-b8f1-e2af368c212d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:35.831417 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f33f451c-ccd4-4880-b8f1-e2af368c212d tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1577 microversion: 2.1 time: 0.169091 Jun 04 18:43:35.831987 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 536/1083] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:35 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:35.941082 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a9b3b515-4550-42a4-9e4e-50a1adf53731 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:35.949468 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a9b3b515-4550-42a4-9e4e-50a1adf53731 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.162522 Jun 04 18:43:35.950087 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 548/1084] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:35 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:43:36.187333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:36.187986 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:36.195863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:36.196439 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:36.197244 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:36.197688 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:36.289802 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-78ba258d-230d-4863-be50-9c00c84fa9c3 req-c9f8985e-a21c-4a58-b921-fbc6bc82ccee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf23d455-c4ee-41bb-b074-7a2e399fd8c0", "name": "network-vif-deleted", "tag": "9892af68-c3a6-4862-855b-ea6a4e9a33c2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:36.298960 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-78ba258d-230d-4863-be50-9c00c84fa9c3 req-c9f8985e-a21c-4a58-b921-fbc6bc82ccee service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:36.299412 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-78ba258d-230d-4863-be50-9c00c84fa9c3 req-c9f8985e-a21c-4a58-b921-fbc6bc82ccee service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:36.311304 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-78ba258d-230d-4863-be50-9c00c84fa9c3 req-c9f8985e-a21c-4a58-b921-fbc6bc82ccee service nova] Creating event network-vif-deleted:9892af68-c3a6-4862-855b-ea6a4e9a33c2 for instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 on hv-cinder-79053 Jun 04 18:43:36.316432 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-78ba258d-230d-4863-be50-9c00c84fa9c3 req-c9f8985e-a21c-4a58-b921-fbc6bc82ccee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030756 Jun 04 18:43:36.317070 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 549/1085] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:43:36.332107 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:36.340224 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:36.341692 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:36.342842 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-29537f8f-d17e-4beb-a305-066b25c61876 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1729 microversion: 2.20 time: 0.159975 Jun 04 18:43:36.343382 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 537/1086] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:36 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:43:36.849937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:36.850640 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:36.857447 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:36.857924 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:36.858694 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:36.859132 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:36.896475 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:36.897036 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:36.897665 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lazy-loading 'fault' on Instance uuid cf23d455-c4ee-41bb-b074-7a2e399fd8c0 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:43:36.946872 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf94c76ba04b403b91a7ff77a2f476e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2829dcddd2864698b273038b8df5ce76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:36.955118 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-198a36ff-521b-4f2a-87b0-6085aef67569 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 200 len: 1230 microversion: 2.1 time: 0.109917 Jun 04 18:43:36.955654 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 550/1087] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:36 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:36.968419 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3e5439d6-dcaa-47f3-8d5a-c14a005a27f1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:36.969702 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3e5439d6-dcaa-47f3-8d5a-c14a005a27f1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:36.977237 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e5439d6-dcaa-47f3-8d5a-c14a005a27f1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:36.977951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e5439d6-dcaa-47f3-8d5a-c14a005a27f1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:36.978736 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e5439d6-dcaa-47f3-8d5a-c14a005a27f1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:36.979176 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e5439d6-dcaa-47f3-8d5a-c14a005a27f1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:37.115905 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3e5439d6-dcaa-47f3-8d5a-c14a005a27f1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:37.123486 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3e5439d6-dcaa-47f3-8d5a-c14a005a27f1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.160670 Jun 04 18:43:37.124091 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 538/1088] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:36 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:37.361552 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:37.362477 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:37.369545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:37.369991 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:37.370749 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:37.371182 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:37.502799 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:37.511929 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:37.513458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:37.514618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0e330fa8-1781-4897-8f4d-a8616c08f042 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1716 microversion: 2.20 time: 0.157375 Jun 04 18:43:37.515180 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 551/1089] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:43:37 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 18:43:37.976386 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:37.977450 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: cf23d455-c4ee-41bb-b074-7a2e399fd8c0] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:37.988594 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:37.989334 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:37.990702 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:37.991253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:37.995365 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:38.005876 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] HTTP exception thrown: Instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 could not be found. Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Request method failure captured: Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 HTTP/1.1 Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6WxdfSUl0tipBd3mtfxBqzOQ7RaxEa1Kt3hnaIVE-cssElfw3iwz56KTq3Fp-PxoMoEvY9i5mTlerhn4BmF6kl2IPjyDgwXCKduFwAvVMWbkHtYD_bUoREJY32lwaPezxWNU5MCmrlqAQ1RSEzuDCSmwujTol_xEQ6K8l5YUc0hXUw Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:43:38.007677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}] Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: cf94c76ba04b403b91a7ff77a2f476e8 Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 could not be found. Jun 04 18:43:38.009494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'cf23d455-c4ee-41bb-b074-7a2e399fd8c0'} Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 could not be found. Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:43:38.010677 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 could not be found. Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 could not be found. Jun 04 18:43:38.012667 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.014123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Returning 404 to user: Instance cf23d455-c4ee-41bb-b074-7a2e399fd8c0 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:43:38.014123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-993c8ee8-4ebe-491e-89ed-695597b4d239 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0" status: 404 len: 111 microversion: 2.1 time: 0.039757 Jun 04 18:43:38.014123 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 539/1090] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:37 2022] GET /compute/v2.1/servers/cf23d455-c4ee-41bb-b074-7a2e399fd8c0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:43:38.141075 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b411ded1-9943-4e6e-9baa-bfc60d4ddd5d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:38.141687 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b411ded1-9943-4e6e-9baa-bfc60d4ddd5d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:38.143731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=88 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:38.150169 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b411ded1-9943-4e6e-9baa-bfc60d4ddd5d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:38.150619 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b411ded1-9943-4e6e-9baa-bfc60d4ddd5d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:38.151394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b411ded1-9943-4e6e-9baa-bfc60d4ddd5d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:38.151831 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b411ded1-9943-4e6e-9baa-bfc60d4ddd5d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:38.297267 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b411ded1-9943-4e6e-9baa-bfc60d4ddd5d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:38.304337 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b411ded1-9943-4e6e-9baa-bfc60d4ddd5d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.166978 Jun 04 18:43:38.314126 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 552/1091] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:38 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:38.700501 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:38.701004 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:38.707617 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:38.708130 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:38.708980 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:38.709420 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:38.723250 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] HTTP exception thrown: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Request method failure captured: Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 HTTP/1.1 Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6WxdfSUl0tipBd3mtfxBqzOQ7RaxEa1Kt3hnaIVE-cssElfw3iwz56KTq3Fp-PxoMoEvY9i5mTlerhn4BmF6kl2IPjyDgwXCKduFwAvVMWbkHtYD_bUoREJY32lwaPezxWNU5MCmrlqAQ1RSEzuDCSmwujTol_xEQ6K8l5YUc0hXUw Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:43:38.724841 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}] Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: cf94c76ba04b403b91a7ff77a2f476e8 Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.726485 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'e19a4a77-7305-41d2-913c-d40b18d5d926'} Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:43:38.727396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.729013 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.730758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Returning 404 to user: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:43:38.730758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ddba86a3-2369-4db1-88b5-59ca11f519b8 tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 404 len: 111 microversion: 2.1 time: 0.030230 Jun 04 18:43:38.730758 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 540/1092] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:43:38 2022] DELETE /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:43:38.735075 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:38.735692 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] [instance: e19a4a77-7305-41d2-913c-d40b18d5d926] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:38.745264 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:38.745698 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:38.746475 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:38.746916 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:38.761054 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] HTTP exception thrown: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Request method failure captured: Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 HTTP/1.1 Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6WxdfSUl0tipBd3mtfxBqzOQ7RaxEa1Kt3hnaIVE-cssElfw3iwz56KTq3Fp-PxoMoEvY9i5mTlerhn4BmF6kl2IPjyDgwXCKduFwAvVMWbkHtYD_bUoREJY32lwaPezxWNU5MCmrlqAQ1RSEzuDCSmwujTol_xEQ6K8l5YUc0hXUw Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:43:38.762699 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2829dcddd2864698b273038b8df5ce76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2829dcddd2864698b273038b8df5ce76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2829dcddd2864698b273038b8df5ce76"}]}] Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 2829dcddd2864698b273038b8df5ce76 Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-TestVolumeBootPattern-1349909260 Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: cf94c76ba04b403b91a7ff77a2f476e8 Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-TestVolumeBootPattern-1349909260-project Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.764274 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'e19a4a77-7305-41d2-913c-d40b18d5d926'} Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:43:38.766045 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. Jun 04 18:43:38.767625 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:43:38.769028 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Returning 404 to user: Instance e19a4a77-7305-41d2-913c-d40b18d5d926 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:43:38.769028 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c687f88d-4587-4adf-b78c-2dc5aabb2b6b tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926" status: 404 len: 111 microversion: 2.1 time: 0.032959 Jun 04 18:43:38.769028 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 553/1093] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:38 2022] GET /compute/v2.1/servers/e19a4a77-7305-41d2-913c-d40b18d5d926 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:43:39.322039 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-08cfd9ab-ad93-49bd-b103-0214f00c0521 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:39.322645 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-08cfd9ab-ad93-49bd-b103-0214f00c0521 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:39.329688 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08cfd9ab-ad93-49bd-b103-0214f00c0521 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:39.330134 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08cfd9ab-ad93-49bd-b103-0214f00c0521 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:39.330892 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08cfd9ab-ad93-49bd-b103-0214f00c0521 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:39.331321 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08cfd9ab-ad93-49bd-b103-0214f00c0521 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:39.470028 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-08cfd9ab-ad93-49bd-b103-0214f00c0521 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:39.477965 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-08cfd9ab-ad93-49bd-b103-0214f00c0521 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.159780 Jun 04 18:43:39.478494 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 541/1094] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:39 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:40.099110 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5324220b-95f1-47e7-aa58-7b95e75683ed tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] Calling method '.version_select at 0x7f467ddbfb80>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:40.125519 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5324220b-95f1-47e7-aa58-7b95e75683ed tempest-TestVolumeBootPattern-1349909260 tempest-TestVolumeBootPattern-1349909260-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-493393868" status: 202 len: 0 microversion: 2.1 time: 0.030306 Jun 04 18:43:40.126177 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 554/1095] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 4 18:43:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-493393868 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:43:40.495101 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7301794f-0fa3-4330-a7a0-7fddf9ba7ee9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:40.496162 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7301794f-0fa3-4330-a7a0-7fddf9ba7ee9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:40.498629 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:40.504963 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7301794f-0fa3-4330-a7a0-7fddf9ba7ee9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:40.505509 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7301794f-0fa3-4330-a7a0-7fddf9ba7ee9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:40.506532 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7301794f-0fa3-4330-a7a0-7fddf9ba7ee9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:40.507131 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7301794f-0fa3-4330-a7a0-7fddf9ba7ee9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:40.773183 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7301794f-0fa3-4330-a7a0-7fddf9ba7ee9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:40.782199 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7301794f-0fa3-4330-a7a0-7fddf9ba7ee9 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.290815 Jun 04 18:43:40.792979 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 542/1096] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:40 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:41.800963 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8595ddd7-a759-4c63-bbae-934358681c51 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:41.801684 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8595ddd7-a759-4c63-bbae-934358681c51 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:41.809875 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8595ddd7-a759-4c63-bbae-934358681c51 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:41.812326 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8595ddd7-a759-4c63-bbae-934358681c51 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:41.813184 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8595ddd7-a759-4c63-bbae-934358681c51 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:41.813616 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8595ddd7-a759-4c63-bbae-934358681c51 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:42.032341 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8595ddd7-a759-4c63-bbae-934358681c51 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:42.040742 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8595ddd7-a759-4c63-bbae-934358681c51 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.244742 Jun 04 18:43:42.041390 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 555/1097] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:41 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:42.448272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-de03f49d-a514-47ff-a5f3-25909e56389c req-697dc167-1e74-454d-84a4-8612302440ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ab534c-de63-4e2e-84a4-ed1072d868d5", "name": "network-vif-plugged", "status": "completed", "tag": "35ec7e5f-d6aa-48ed-bcce-e38d546401a3"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:43:42.458358 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-de03f49d-a514-47ff-a5f3-25909e56389c req-697dc167-1e74-454d-84a4-8612302440ef service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:42.458811 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-de03f49d-a514-47ff-a5f3-25909e56389c req-697dc167-1e74-454d-84a4-8612302440ef service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:42.476448 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-de03f49d-a514-47ff-a5f3-25909e56389c req-697dc167-1e74-454d-84a4-8612302440ef service nova] Creating event network-vif-plugged:35ec7e5f-d6aa-48ed-bcce-e38d546401a3 for instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 on hv-cinder-79053 Jun 04 18:43:42.486257 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-de03f49d-a514-47ff-a5f3-25909e56389c req-697dc167-1e74-454d-84a4-8612302440ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041329 Jun 04 18:43:42.488208 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 543/1098] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:43:43.059082 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dfc21cbe-ca33-433f-a266-eacf8b2373ec tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:43.059690 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dfc21cbe-ca33-433f-a266-eacf8b2373ec tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:43.066811 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dfc21cbe-ca33-433f-a266-eacf8b2373ec tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:43.067249 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dfc21cbe-ca33-433f-a266-eacf8b2373ec tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:43.068037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dfc21cbe-ca33-433f-a266-eacf8b2373ec tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:43.068503 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dfc21cbe-ca33-433f-a266-eacf8b2373ec tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:43.277707 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dfc21cbe-ca33-433f-a266-eacf8b2373ec tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:43.286767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dfc21cbe-ca33-433f-a266-eacf8b2373ec tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.231207 Jun 04 18:43:43.287422 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 556/1099] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:43 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:44.318435 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-47968d8e-b81a-4f23-8658-104c6c4054a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:44.319215 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-47968d8e-b81a-4f23-8658-104c6c4054a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:44.326497 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47968d8e-b81a-4f23-8658-104c6c4054a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:44.327213 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47968d8e-b81a-4f23-8658-104c6c4054a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:44.328163 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47968d8e-b81a-4f23-8658-104c6c4054a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:44.328764 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47968d8e-b81a-4f23-8658-104c6c4054a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:44.468245 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-47968d8e-b81a-4f23-8658-104c6c4054a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:44.476067 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-47968d8e-b81a-4f23-8658-104c6c4054a1 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1572 microversion: 2.1 time: 0.174741 Jun 04 18:43:44.476749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 544/1100] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:44 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1572 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:43:45.493878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c0700bfd-dff5-4e49-a87b-c7ee982dd441 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:43:45.494477 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c0700bfd-dff5-4e49-a87b-c7ee982dd441 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:43:45.501278 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0700bfd-dff5-4e49-a87b-c7ee982dd441 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:45.502048 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0700bfd-dff5-4e49-a87b-c7ee982dd441 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:45.503060 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0700bfd-dff5-4e49-a87b-c7ee982dd441 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:43:45.503717 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0700bfd-dff5-4e49-a87b-c7ee982dd441 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:43:45.508345 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:45.728449 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c0700bfd-dff5-4e49-a87b-c7ee982dd441 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:43:45.736703 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c0700bfd-dff5-4e49-a87b-c7ee982dd441 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1559 microversion: 2.1 time: 0.246811 Jun 04 18:43:45.737512 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 557/1101] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:43:45 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1559 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:33.011833 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2bd9cb2e-460d-47cd-9669-993c455d17fd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:33.012847 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2bd9cb2e-460d-47cd-9669-993c455d17fd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:33.015119 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=5 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:33.015798 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=22 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:33.024544 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2bd9cb2e-460d-47cd-9669-993c455d17fd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:33.025142 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2bd9cb2e-460d-47cd-9669-993c455d17fd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:33.026501 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2bd9cb2e-460d-47cd-9669-993c455d17fd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:33.027131 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2bd9cb2e-460d-47cd-9669-993c455d17fd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:33.058640 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2bd9cb2e-460d-47cd-9669-993c455d17fd tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051036 Jun 04 18:44:33.059198 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 545/1102] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 4 18:44:33 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:33.120799 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1dba8ac3-a3a7-48a7-ac44-2df881539fff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:33.121356 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1dba8ac3-a3a7-48a7-ac44-2df881539fff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:33.123987 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:33.124654 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=5 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:33.130736 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1dba8ac3-a3a7-48a7-ac44-2df881539fff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:33.131180 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1dba8ac3-a3a7-48a7-ac44-2df881539fff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:33.131953 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1dba8ac3-a3a7-48a7-ac44-2df881539fff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:33.132424 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1dba8ac3-a3a7-48a7-ac44-2df881539fff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:33.159627 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1dba8ac3-a3a7-48a7-ac44-2df881539fff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:44:33.245248 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1dba8ac3-a3a7-48a7-ac44-2df881539fff tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "DELETE /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 204 len: 0 microversion: 2.20 time: 0.127905 Jun 04 18:44:33.245767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 558/1103] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 4 18:44:33 2022] DELETE /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 18:44:33.254807 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:33.255426 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:33.261534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:33.261984 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:33.262747 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:33.263856 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:33.654852 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:33.668091 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:33.669854 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:33.671197 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-afa9b1b1-1ba6-4f17-b06c-0c093952ff04 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.421082 Jun 04 18:44:33.671727 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 546/1104] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:44:33 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:44:34.695895 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:34.696633 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:34.703910 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:34.704392 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:34.705170 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:34.705609 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:34.902673 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:34.914051 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:34.915634 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:34.917584 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-84c606f2-4477-4e00-ada9-ca3af3187ce2 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1722 microversion: 2.20 time: 0.225751 Jun 04 18:44:34.918439 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 559/1105] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:44:34 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:44:35.877272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-210c655b-d4cd-46f3-a2ba-60b725dae942 req-0c21cfbf-57e5-4c8e-8ac4-35617db979f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02795c57-88a4-46ac-be72-8c43dc178e4f", "name": "network-vif-deleted", "tag": "0e876440-c9c1-4ed0-be90-0af7d5fd38fe"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:44:35.886377 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-210c655b-d4cd-46f3-a2ba-60b725dae942 req-0c21cfbf-57e5-4c8e-8ac4-35617db979f1 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:35.887017 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-210c655b-d4cd-46f3-a2ba-60b725dae942 req-0c21cfbf-57e5-4c8e-8ac4-35617db979f1 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:35.899739 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-210c655b-d4cd-46f3-a2ba-60b725dae942 req-0c21cfbf-57e5-4c8e-8ac4-35617db979f1 service nova] Creating event network-vif-deleted:0e876440-c9c1-4ed0-be90-0af7d5fd38fe for instance 02795c57-88a4-46ac-be72-8c43dc178e4f on hv-cinder-79053 Jun 04 18:44:35.905831 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-210c655b-d4cd-46f3-a2ba-60b725dae942 req-0c21cfbf-57e5-4c8e-8ac4-35617db979f1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032028 Jun 04 18:44:35.909517 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 547/1106] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:44:35.938256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:35.938815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:35.945765 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:35.946213 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:35.946979 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:35.947407 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:36.030296 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:36.041193 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:36.042731 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ceccf3f6ce044b98503b09b13cd2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a5168618d4511a41baa4f25425b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:36.043895 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4dd7ef46-12d7-431b-80b5-0dacbc3b8084 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 200 len: 1366 microversion: 2.20 time: 0.110863 Jun 04 18:44:36.045218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 560/1107] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:44:35 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 18:44:37.065257 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:37.065906 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:37.073752 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:37.074273 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:37.075160 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:37.075798 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:37.090015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] HTTP exception thrown: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Request method failure captured: Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f HTTP/1.1 Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6Y3mySA38CSk9uFqcSfPF-ofZE-pkMVA3bGNig9VhbQYdLTelikv97Y64UQS4rxUC-f_Xqkv7dk8g4DWjhEhucJtsP2BtQ4QU5cnU95crj74Xr7afOOaXST74iJMPTYUzFt_5yGB9-POOuXMomhDK9_5VpnIPZcO8YwnWXE7JlCQ98 Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:44:37.091728 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}] Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 6ceccf3f6ce044b98503b09b13cd2510 Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:37.093337 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '02795c57-88a4-46ac-be72-8c43dc178e4f'} Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:44:37.094230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:37.095671 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:37.097339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Returning 404 to user: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:44:37.097339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-08409a44-0f6a-42a4-9ae7-ea1a447f4010 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 404 len: 111 microversion: 2.20 time: 0.033728 Jun 04 18:44:37.097339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 548/1108] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:44:37 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:44:37.102215 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-80b6fd26-78e3-4a43-a8a1-b1bf2c591d30 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '.version_select at 0x7f467e860ca0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:37.123440 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-80b6fd26-78e3-4a43-a8a1-b1bf2c591d30 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815953202" status: 204 len: 0 microversion: 2.20 time: 0.024972 Jun 04 18:44:37.123993 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 561/1109] 10.222.0.39 () {60 vars in 1258 bytes} [Sat Jun 4 18:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815953202 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 18:44:39.151475 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:39.152090 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:39.162432 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:39.162994 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:39.163955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:39.164505 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:39.180409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] HTTP exception thrown: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Request method failure captured: Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f HTTP/1.1 Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6Y3mySA38CSk9uFqcSfPF-ofZE-pkMVA3bGNig9VhbQYdLTelikv97Y64UQS4rxUC-f_Xqkv7dk8g4DWjhEhucJtsP2BtQ4QU5cnU95crj74Xr7afOOaXST74iJMPTYUzFt_5yGB9-POOuXMomhDK9_5VpnIPZcO8YwnWXE7JlCQ98 Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:44:39.181961 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}] Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 6ceccf3f6ce044b98503b09b13cd2510 Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.183599 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '02795c57-88a4-46ac-be72-8c43dc178e4f'} Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:44:39.184679 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.186267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.188240 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Returning 404 to user: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:44:39.188240 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0f53b66d-f234-49c8-ab5d-8cb44eebc2f1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "DELETE /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 404 len: 111 microversion: 2.20 time: 0.037879 Jun 04 18:44:39.188240 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 549/1110] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 4 18:44:39 2022] DELETE /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:44:39.195047 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:39.195764 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: 02795c57-88a4-46ac-be72-8c43dc178e4f] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:39.204587 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:39.205035 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:39.205806 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:39.206246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:39.219741 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] HTTP exception thrown: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Request method failure captured: Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f HTTP/1.1 Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6Y3mySA38CSk9uFqcSfPF-ofZE-pkMVA3bGNig9VhbQYdLTelikv97Y64UQS4rxUC-f_Xqkv7dk8g4DWjhEhucJtsP2BtQ4QU5cnU95crj74Xr7afOOaXST74iJMPTYUzFt_5yGB9-POOuXMomhDK9_5VpnIPZcO8YwnWXE7JlCQ98 Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:44:39.222372 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}] Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 6ceccf3f6ce044b98503b09b13cd2510 Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.224154 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': '02795c57-88a4-46ac-be72-8c43dc178e4f'} Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:44:39.225300 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. Jun 04 18:44:39.226816 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:39.228127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Returning 404 to user: Instance 02795c57-88a4-46ac-be72-8c43dc178e4f could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:44:39.228127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-560e4e3d-2b77-47fd-a3ce-24bfbfea7af1 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f" status: 404 len: 111 microversion: 2.20 time: 0.035513 Jun 04 18:44:39.228127 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 562/1111] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:44:39 2022] GET /compute/v2.1/servers/02795c57-88a4-46ac-be72-8c43dc178e4f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:44:40.385017 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:40.385631 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:40.392586 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:40.393052 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:40.393833 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:40.394272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:40.408208 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] HTTP exception thrown: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Request method failure captured: Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 HTTP/1.1 Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6Y3mySA38CSk9uFqcSfPF-ofZE-pkMVA3bGNig9VhbQYdLTelikv97Y64UQS4rxUC-f_Xqkv7dk8g4DWjhEhucJtsP2BtQ4QU5cnU95crj74Xr7afOOaXST74iJMPTYUzFt_5yGB9-POOuXMomhDK9_5VpnIPZcO8YwnWXE7JlCQ98 Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:44:40.409909 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}] Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 6ceccf3f6ce044b98503b09b13cd2510 Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.411738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'ba7020d7-a1c8-41d2-8172-08a5c8438167'} Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:44:40.413968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.415418 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.416951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Returning 404 to user: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:44:40.416951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dfcffcd9-fe44-48c3-b5e4-c2db691351f7 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 404 len: 111 microversion: 2.20 time: 0.030641 Jun 04 18:44:40.416951 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 550/1112] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 4 18:44:40 2022] DELETE /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:44:40.420579 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:40.421188 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] [instance: ba7020d7-a1c8-41d2-8172-08a5c8438167] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:40.428023 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:40.428495 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:40.429268 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:40.429705 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:40.443667 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] HTTP exception thrown: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Request method failure captured: Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 HTTP/1.1 Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6Y3mySA38CSk9uFqcSfPF-ofZE-pkMVA3bGNig9VhbQYdLTelikv97Y64UQS4rxUC-f_Xqkv7dk8g4DWjhEhucJtsP2BtQ4QU5cnU95crj74Xr7afOOaXST74iJMPTYUzFt_5yGB9-POOuXMomhDK9_5VpnIPZcO8YwnWXE7JlCQ98 Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:44:40.445218 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1c1a5168618d4511a41baa4f25425b86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1c1a5168618d4511a41baa4f25425b86"}]}] Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 1c1a5168618d4511a41baa4f25425b86 Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269822368 Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 6ceccf3f6ce044b98503b09b13cd2510 Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269822368-project Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.446927 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'ba7020d7-a1c8-41d2-8172-08a5c8438167'} Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:44:40.447878 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. Jun 04 18:44:40.449428 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:44:40.450756 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] Returning 404 to user: Instance ba7020d7-a1c8-41d2-8172-08a5c8438167 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:44:40.450756 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-58f3b85a-67ab-447b-b6dd-ce0dd40eac49 tempest-AttachVolumeShelveTestJSON-269822368 tempest-AttachVolumeShelveTestJSON-269822368-project] 10.222.0.39 "GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167" status: 404 len: 111 microversion: 2.20 time: 0.030240 Jun 04 18:44:40.450756 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 563/1113] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 4 18:44:40 2022] GET /compute/v2.1/servers/ba7020d7-a1c8-41d2-8172-08a5c8438167 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 18:44:46.897138 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1638837390", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "networks": [{"uuid": "78ff616f-0ae5-4d27-bb9a-a04fe41aee8d"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:44:46.954995 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] validate_networks() for [('78ff616f-0ae5-4d27-bb9a-a04fe41aee8d', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:44:47.351793 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:44:47.352272 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:44:47.352754 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:44:47.353177 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:44:47.353597 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:44:47.363223 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:47.363688 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:47.364534 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:47.364974 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:47.381739 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Getting quotas for project b343ebf1f80e474fa583574db40b1cba. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:44:47.385990 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Getting quotas for user 73bfcdd0f3504778a4fc65dcf2471e77 and project b343ebf1f80e474fa583574db40b1cba. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:44:47.397286 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:44:47.399469 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:44:47.445234 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d46c1c7e-8176-4bb8-8ab1-aa485f98efa2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552673 Jun 04 18:44:47.445910 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 551/1114] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:44:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:44:47.456325 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-39164af8-5295-44fa-b1d1-329d52eb93da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:47.456935 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-39164af8-5295-44fa-b1d1-329d52eb93da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:47.521844 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-39164af8-5295-44fa-b1d1-329d52eb93da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:47.528891 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-39164af8-5295-44fa-b1d1-329d52eb93da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1214 microversion: 2.1 time: 0.076568 Jun 04 18:44:47.529463 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 564/1115] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:47 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:48.547325 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-29844886-be49-4189-ab51-05a16ce90332 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:48.548373 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-29844886-be49-4189-ab51-05a16ce90332 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:48.554891 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29844886-be49-4189-ab51-05a16ce90332 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:48.555425 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29844886-be49-4189-ab51-05a16ce90332 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:48.556354 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29844886-be49-4189-ab51-05a16ce90332 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:48.556922 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29844886-be49-4189-ab51-05a16ce90332 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:48.636396 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-29844886-be49-4189-ab51-05a16ce90332 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:48.644810 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-29844886-be49-4189-ab51-05a16ce90332 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1284 microversion: 2.1 time: 0.101955 Jun 04 18:44:48.645329 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 552/1116] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:48 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:49.662947 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-efc5520b-288f-4930-8c4e-2c743b8c06c5 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:49.663514 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-efc5520b-288f-4930-8c4e-2c743b8c06c5 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:49.671155 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efc5520b-288f-4930-8c4e-2c743b8c06c5 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:49.671607 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efc5520b-288f-4930-8c4e-2c743b8c06c5 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:49.672409 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efc5520b-288f-4930-8c4e-2c743b8c06c5 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:49.673490 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efc5520b-288f-4930-8c4e-2c743b8c06c5 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:49.806989 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-efc5520b-288f-4930-8c4e-2c743b8c06c5 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:49.814630 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-efc5520b-288f-4930-8c4e-2c743b8c06c5 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1314 microversion: 2.1 time: 0.156212 Jun 04 18:44:49.815256 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 565/1117] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:49 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:50.298045 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-8cbc0b4d-e911-4ec4-9d6c-f33484909e76 req-bc26f983-e08c-4a48-81af-4845445c9c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20e0e50-a9f2-4bb1-81e2-146f86ee5861", "tag": "6efaab04-e84e-4f0b-89c5-679da81fc896"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:44:50.306876 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-8cbc0b4d-e911-4ec4-9d6c-f33484909e76 req-bc26f983-e08c-4a48-81af-4845445c9c11 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:50.307244 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-8cbc0b4d-e911-4ec4-9d6c-f33484909e76 req-bc26f983-e08c-4a48-81af-4845445c9c11 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:50.319955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-8cbc0b4d-e911-4ec4-9d6c-f33484909e76 req-bc26f983-e08c-4a48-81af-4845445c9c11 service nova] Creating event network-changed:6efaab04-e84e-4f0b-89c5-679da81fc896 for instance a20e0e50-a9f2-4bb1-81e2-146f86ee5861 on hv-cinder-79053 Jun 04 18:44:50.325419 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-8cbc0b4d-e911-4ec4-9d6c-f33484909e76 req-bc26f983-e08c-4a48-81af-4845445c9c11 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162728 Jun 04 18:44:50.326015 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 553/1118] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:44:50.835734 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e63abeac-7d52-4d0b-9395-9d58957d7b08 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:50.836561 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e63abeac-7d52-4d0b-9395-9d58957d7b08 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:50.846935 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e63abeac-7d52-4d0b-9395-9d58957d7b08 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:50.847397 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e63abeac-7d52-4d0b-9395-9d58957d7b08 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:50.848205 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e63abeac-7d52-4d0b-9395-9d58957d7b08 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:50.848649 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e63abeac-7d52-4d0b-9395-9d58957d7b08 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:50.985957 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e63abeac-7d52-4d0b-9395-9d58957d7b08 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:50.994113 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e63abeac-7d52-4d0b-9395-9d58957d7b08 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1314 microversion: 2.1 time: 0.164604 Jun 04 18:44:50.994685 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 566/1119] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:50 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:52.016710 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a846d3bb-55c1-4572-b567-00826e303765 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:52.017846 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a846d3bb-55c1-4572-b567-00826e303765 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:52.025462 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a846d3bb-55c1-4572-b567-00826e303765 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:52.025936 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a846d3bb-55c1-4572-b567-00826e303765 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:52.026683 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a846d3bb-55c1-4572-b567-00826e303765 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:52.027110 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a846d3bb-55c1-4572-b567-00826e303765 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:52.169025 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a846d3bb-55c1-4572-b567-00826e303765 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:52.181168 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a846d3bb-55c1-4572-b567-00826e303765 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1314 microversion: 2.1 time: 0.171580 Jun 04 18:44:52.181933 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 554/1120] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:52 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:53.205513 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3cfd019c-39b8-47c2-91bd-bb57f4a4c1aa tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:53.206943 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3cfd019c-39b8-47c2-91bd-bb57f4a4c1aa tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:53.213915 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3cfd019c-39b8-47c2-91bd-bb57f4a4c1aa tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:53.214358 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3cfd019c-39b8-47c2-91bd-bb57f4a4c1aa tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:53.215125 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3cfd019c-39b8-47c2-91bd-bb57f4a4c1aa tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:53.215555 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3cfd019c-39b8-47c2-91bd-bb57f4a4c1aa tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:53.354493 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3cfd019c-39b8-47c2-91bd-bb57f4a4c1aa tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:53.365112 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3cfd019c-39b8-47c2-91bd-bb57f4a4c1aa tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1314 microversion: 2.1 time: 0.166148 Jun 04 18:44:53.365675 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 567/1121] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:53 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:54.386029 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2b47576f-d9be-4f36-9b5c-606a6f8b89c3 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:54.387037 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2b47576f-d9be-4f36-9b5c-606a6f8b89c3 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:54.398151 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b47576f-d9be-4f36-9b5c-606a6f8b89c3 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:54.398865 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b47576f-d9be-4f36-9b5c-606a6f8b89c3 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:54.400170 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b47576f-d9be-4f36-9b5c-606a6f8b89c3 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:54.400896 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b47576f-d9be-4f36-9b5c-606a6f8b89c3 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:54.543724 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2b47576f-d9be-4f36-9b5c-606a6f8b89c3 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:54.551920 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2b47576f-d9be-4f36-9b5c-606a6f8b89c3 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1314 microversion: 2.1 time: 0.172394 Jun 04 18:44:54.552556 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 555/1122] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:54 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:55.573874 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-96d5b200-7814-4bbd-ac23-a72a12877595 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:55.574862 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-96d5b200-7814-4bbd-ac23-a72a12877595 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:55.584351 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96d5b200-7814-4bbd-ac23-a72a12877595 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:55.584803 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96d5b200-7814-4bbd-ac23-a72a12877595 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:55.585570 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96d5b200-7814-4bbd-ac23-a72a12877595 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:55.586002 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96d5b200-7814-4bbd-ac23-a72a12877595 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:55.730744 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-96d5b200-7814-4bbd-ac23-a72a12877595 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:55.739409 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-96d5b200-7814-4bbd-ac23-a72a12877595 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1314 microversion: 2.1 time: 0.172103 Jun 04 18:44:55.739957 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 568/1123] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:55 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:56.761486 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b8ae4bc0-a037-424d-a6fb-6d3f12bd62e9 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:56.762332 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b8ae4bc0-a037-424d-a6fb-6d3f12bd62e9 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:56.769020 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8ae4bc0-a037-424d-a6fb-6d3f12bd62e9 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:56.769464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8ae4bc0-a037-424d-a6fb-6d3f12bd62e9 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:56.770232 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8ae4bc0-a037-424d-a6fb-6d3f12bd62e9 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:56.770661 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8ae4bc0-a037-424d-a6fb-6d3f12bd62e9 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:56.796853 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-8fe31b6e-1f21-4ace-a993-e3c626254cfc req-df11012a-4551-44e3-b21b-aa489782f536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20e0e50-a9f2-4bb1-81e2-146f86ee5861", "name": "network-vif-plugged", "status": "completed", "tag": "6efaab04-e84e-4f0b-89c5-679da81fc896"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:44:56.807398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-8fe31b6e-1f21-4ace-a993-e3c626254cfc req-df11012a-4551-44e3-b21b-aa489782f536 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:56.807922 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-8fe31b6e-1f21-4ace-a993-e3c626254cfc req-df11012a-4551-44e3-b21b-aa489782f536 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:56.820246 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-8fe31b6e-1f21-4ace-a993-e3c626254cfc req-df11012a-4551-44e3-b21b-aa489782f536 service nova] Creating event network-vif-plugged:6efaab04-e84e-4f0b-89c5-679da81fc896 for instance a20e0e50-a9f2-4bb1-81e2-146f86ee5861 on hv-cinder-79053 Jun 04 18:44:56.825413 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-8fe31b6e-1f21-4ace-a993-e3c626254cfc req-df11012a-4551-44e3-b21b-aa489782f536 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032304 Jun 04 18:44:56.826221 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 569/1124] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:44:56.913042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b8ae4bc0-a037-424d-a6fb-6d3f12bd62e9 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:56.921039 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b8ae4bc0-a037-424d-a6fb-6d3f12bd62e9 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1314 microversion: 2.1 time: 0.163582 Jun 04 18:44:56.921700 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 556/1125] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:56 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:57.935656 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:57.940332 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f46be532-4f57-4f8e-a4c2-e3551b24d083 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:57.941078 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f46be532-4f57-4f8e-a4c2-e3551b24d083 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:57.947914 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f46be532-4f57-4f8e-a4c2-e3551b24d083 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:57.948463 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f46be532-4f57-4f8e-a4c2-e3551b24d083 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:57.949199 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f46be532-4f57-4f8e-a4c2-e3551b24d083 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:57.949630 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f46be532-4f57-4f8e-a4c2-e3551b24d083 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:58.080684 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f46be532-4f57-4f8e-a4c2-e3551b24d083 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:58.088398 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f46be532-4f57-4f8e-a4c2-e3551b24d083 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1314 microversion: 2.1 time: 0.153770 Jun 04 18:44:58.088966 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 570/1126] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:57 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:59.109253 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fa8c1981-83fa-4f0d-8671-744a0c155b80 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:59.110182 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fa8c1981-83fa-4f0d-8671-744a0c155b80 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:59.113314 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:59.114308 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:59.125752 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa8c1981-83fa-4f0d-8671-744a0c155b80 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:59.126421 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa8c1981-83fa-4f0d-8671-744a0c155b80 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:59.127738 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa8c1981-83fa-4f0d-8671-744a0c155b80 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:59.128429 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fa8c1981-83fa-4f0d-8671-744a0c155b80 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:59.266950 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fa8c1981-83fa-4f0d-8671-744a0c155b80 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:59.275099 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fa8c1981-83fa-4f0d-8671-744a0c155b80 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1499 microversion: 2.1 time: 0.172075 Jun 04 18:44:59.275672 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 557/1127] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:59 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1499 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:44:59.697455 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b12acf0e-11d7-4814-91ef-bdd21e8112da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:59.698002 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b12acf0e-11d7-4814-91ef-bdd21e8112da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:59.704937 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b12acf0e-11d7-4814-91ef-bdd21e8112da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:59.705387 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b12acf0e-11d7-4814-91ef-bdd21e8112da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:59.706197 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b12acf0e-11d7-4814-91ef-bdd21e8112da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:59.706745 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b12acf0e-11d7-4814-91ef-bdd21e8112da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:59.733228 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b12acf0e-11d7-4814-91ef-bdd21e8112da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:44:59.819650 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b12acf0e-11d7-4814-91ef-bdd21e8112da tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 204 len: 0 microversion: 2.1 time: 0.125669 Jun 04 18:44:59.820728 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 571/1128] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:44:59 2022] DELETE /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:44:59.829310 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8954beef-ff56-42fe-8dbe-85ab52dc8774 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:44:59.829968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8954beef-ff56-42fe-8dbe-85ab52dc8774 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:44:59.836544 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8954beef-ff56-42fe-8dbe-85ab52dc8774 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:59.837000 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8954beef-ff56-42fe-8dbe-85ab52dc8774 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:59.837781 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8954beef-ff56-42fe-8dbe-85ab52dc8774 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:44:59.838209 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8954beef-ff56-42fe-8dbe-85ab52dc8774 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:44:59.970014 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8954beef-ff56-42fe-8dbe-85ab52dc8774 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:44:59.982042 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8954beef-ff56-42fe-8dbe-85ab52dc8774 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1505 microversion: 2.1 time: 0.156740 Jun 04 18:44:59.982900 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 558/1129] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:44:59 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:01.003659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5ea922ee-2473-4773-abf1-6d89c2256800 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:01.004618 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5ea922ee-2473-4773-abf1-6d89c2256800 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:01.013659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ea922ee-2473-4773-abf1-6d89c2256800 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:01.014258 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ea922ee-2473-4773-abf1-6d89c2256800 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:01.015275 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ea922ee-2473-4773-abf1-6d89c2256800 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:01.015851 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ea922ee-2473-4773-abf1-6d89c2256800 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:01.155310 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5ea922ee-2473-4773-abf1-6d89c2256800 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:01.166000 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5ea922ee-2473-4773-abf1-6d89c2256800 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 200 len: 1505 microversion: 2.1 time: 0.168061 Jun 04 18:45:01.166564 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 572/1130] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:00 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:01.676458 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-37b783f3-94c4-455a-bbb9-290f0fa15e60 req-02c44845-1486-4c30-af7b-656eb60c4180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20e0e50-a9f2-4bb1-81e2-146f86ee5861", "name": "network-vif-deleted", "tag": "6efaab04-e84e-4f0b-89c5-679da81fc896"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:45:01.692351 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-37b783f3-94c4-455a-bbb9-290f0fa15e60 req-02c44845-1486-4c30-af7b-656eb60c4180 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:01.692800 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-37b783f3-94c4-455a-bbb9-290f0fa15e60 req-02c44845-1486-4c30-af7b-656eb60c4180 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:01.705336 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-37b783f3-94c4-455a-bbb9-290f0fa15e60 req-02c44845-1486-4c30-af7b-656eb60c4180 service nova] Creating event network-vif-deleted:6efaab04-e84e-4f0b-89c5-679da81fc896 for instance a20e0e50-a9f2-4bb1-81e2-146f86ee5861 on hv-cinder-79053 Jun 04 18:45:01.712419 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-37b783f3-94c4-455a-bbb9-290f0fa15e60 req-02c44845-1486-4c30-af7b-656eb60c4180 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Jun 04 18:45:01.713218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 559/1131] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:45:02.187055 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:02.187712 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: a20e0e50-a9f2-4bb1-81e2-146f86ee5861] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:02.198074 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:02.198722 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:02.199685 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:02.200226 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:02.215984 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] HTTP exception thrown: Instance a20e0e50-a9f2-4bb1-81e2-146f86ee5861 could not be found. Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Request method failure captured: Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 HTTP/1.1 Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept: application/json Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Connection: close Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Length: 0 Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Content-Type: application/json Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Host: 10.222.0.39 Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABim6gd658D1Qodg2Z8n6iYUAOYv6H56hikF5XGMA3Z_OS4lK5Ub4zfPhKtAOxVLxWom7_FRG6Lk6shdRpK5tPOORgQmCOTtRsoM6mMSr2hhHigP5fIYSa2GkU_kQt1qMkSITf4Gav-jFeYirPXVaVfQKaCwBZ3tUP1i1jFlx0LsgK7pCs Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Id: None Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Domain-Name: None Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Id: b343ebf1f80e474fa583574db40b1cba Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesActionsTest-668050934 Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Role: reader,member Jun 04 18:45:02.217659 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Roles: reader,member Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b343ebf1f80e474fa583574db40b1cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b343ebf1f80e474fa583574db40b1cba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b343ebf1f80e474fa583574db40b1cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b343ebf1f80e474fa583574db40b1cba"}]}] Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesActionsTest-668050934 Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Id: b343ebf1f80e474fa583574db40b1cba Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesActionsTest-668050934 Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesActionsTest-668050934-project Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Id: 73bfcdd0f3504778a4fc65dcf2471e77 Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesActionsTest-668050934-project Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: method: > Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: exception: Instance a20e0e50-a9f2-4bb1-81e2-146f86ee5861 could not be found. Jun 04 18:45:02.219158 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: action_args: {'id': 'a20e0e50-a9f2-4bb1-81e2-146f86ee5861'} Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a20e0e50-a9f2-4bb1-81e2-146f86ee5861 could not be found. Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:45:02.220190 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a20e0e50-a9f2-4bb1-81e2-146f86ee5861 could not be found. Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a20e0e50-a9f2-4bb1-81e2-146f86ee5861 could not be found. Jun 04 18:45:02.222077 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Jun 04 18:45:02.225208 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Returning 404 to user: Instance a20e0e50-a9f2-4bb1-81e2-146f86ee5861 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:45:02.225208 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1961eb04-fb90-438c-a07a-e79b288737bd tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861" status: 404 len: 111 microversion: 2.1 time: 0.038602 Jun 04 18:45:02.225208 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 573/1132] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:02 2022] GET /compute/v2.1/servers/a20e0e50-a9f2-4bb1-81e2-146f86ee5861 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:45:02.271021 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-153901036", "imageRef": "7b72c07f-2816-48a8-878a-4614928533b2", "flavorRef": "452", "networks": [{"uuid": "78ff616f-0ae5-4d27-bb9a-a04fe41aee8d"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:45:02.325197 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] validate_networks() for [('78ff616f-0ae5-4d27-bb9a-a04fe41aee8d', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 18:45:02.703326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 18:45:02.703923 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 18:45:02.704282 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 18:45:02.704689 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 18:45:02.705100 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 18:45:02.714754 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:02.715202 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:02.715987 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:02.716447 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:02.733046 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Getting quotas for project b343ebf1f80e474fa583574db40b1cba. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 18:45:02.737049 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Getting quotas for user 73bfcdd0f3504778a4fc65dcf2471e77 and project b343ebf1f80e474fa583574db40b1cba. Resources: {'ram', 'instances', 'cores'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 18:45:02.747968 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 18:45:02.750329 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b72c07f-2816-48a8-878a-4614928533b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 18:45:02.814375 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-55c7f25e-b4ec-46e2-b128-a152abb0bc68 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547720 Jun 04 18:45:02.815345 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 560/1133] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 4 18:45:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 18:45:02.830921 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fbe795f6-8aac-49ed-ae8c-67716479f2ac tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:02.831539 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fbe795f6-8aac-49ed-ae8c-67716479f2ac tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:02.888179 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fbe795f6-8aac-49ed-ae8c-67716479f2ac tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:02.895641 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fbe795f6-8aac-49ed-ae8c-67716479f2ac tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1213 microversion: 2.1 time: 0.068562 Jun 04 18:45:02.896599 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 574/1134] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:02 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:45:03.913806 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f3ae2e7a-b0df-41dd-8493-06c00780bb18 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:03.914432 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f3ae2e7a-b0df-41dd-8493-06c00780bb18 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:03.916901 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:03.923412 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3ae2e7a-b0df-41dd-8493-06c00780bb18 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:03.924106 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3ae2e7a-b0df-41dd-8493-06c00780bb18 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:03.924883 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3ae2e7a-b0df-41dd-8493-06c00780bb18 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:03.925317 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f3ae2e7a-b0df-41dd-8493-06c00780bb18 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:03.932704 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=65 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:04.005532 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f3ae2e7a-b0df-41dd-8493-06c00780bb18 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:04.024592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f3ae2e7a-b0df-41dd-8493-06c00780bb18 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1271 microversion: 2.1 time: 0.115701 Jun 04 18:45:04.025180 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 561/1135] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:03 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:05.042588 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-819f8556-11ce-4068-8def-c46cab881d31 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:05.043767 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-819f8556-11ce-4068-8def-c46cab881d31 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:05.046241 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:05.056178 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-819f8556-11ce-4068-8def-c46cab881d31 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:05.056790 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-819f8556-11ce-4068-8def-c46cab881d31 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:05.057522 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-819f8556-11ce-4068-8def-c46cab881d31 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:05.057974 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-819f8556-11ce-4068-8def-c46cab881d31 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:05.061163 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:05.089128 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-c5e0124a-3f84-4726-9988-1f8678e446b7 req-8ae4b97d-c18d-4ae2-91e8-b4db9a9a8392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4edb7bb9-8ed7-484b-b75a-bbb036bb9650", "tag": "34dd65f9-8f77-4ec6-8451-7dd60049a50d"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:45:05.099894 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c5e0124a-3f84-4726-9988-1f8678e446b7 req-8ae4b97d-c18d-4ae2-91e8-b4db9a9a8392 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:05.100528 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c5e0124a-3f84-4726-9988-1f8678e446b7 req-8ae4b97d-c18d-4ae2-91e8-b4db9a9a8392 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:05.123792 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-c5e0124a-3f84-4726-9988-1f8678e446b7 req-8ae4b97d-c18d-4ae2-91e8-b4db9a9a8392 service nova] Creating event network-changed:34dd65f9-8f77-4ec6-8451-7dd60049a50d for instance 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 on hv-cinder-79053 Jun 04 18:45:05.128996 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-c5e0124a-3f84-4726-9988-1f8678e446b7 req-8ae4b97d-c18d-4ae2-91e8-b4db9a9a8392 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044499 Jun 04 18:45:05.130146 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 562/1136] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:45:05.203354 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-819f8556-11ce-4068-8def-c46cab881d31 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:05.211307 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-819f8556-11ce-4068-8def-c46cab881d31 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1313 microversion: 2.1 time: 0.172732 Jun 04 18:45:05.211742 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 575/1137] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:05 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:06.233632 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f25c0c7f-6e6b-4177-a2e5-ff0c73ead2c0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:06.235243 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f25c0c7f-6e6b-4177-a2e5-ff0c73ead2c0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:06.243819 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f25c0c7f-6e6b-4177-a2e5-ff0c73ead2c0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:06.244332 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f25c0c7f-6e6b-4177-a2e5-ff0c73ead2c0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:06.245108 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f25c0c7f-6e6b-4177-a2e5-ff0c73ead2c0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:06.245552 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f25c0c7f-6e6b-4177-a2e5-ff0c73ead2c0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:06.385344 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f25c0c7f-6e6b-4177-a2e5-ff0c73ead2c0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:06.393792 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f25c0c7f-6e6b-4177-a2e5-ff0c73ead2c0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1313 microversion: 2.1 time: 0.168366 Jun 04 18:45:06.394426 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 563/1138] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:06 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:07.416636 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bb6eef8a-b677-4608-8f0b-ad4f09a851f2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:07.417245 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bb6eef8a-b677-4608-8f0b-ad4f09a851f2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:07.424175 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb6eef8a-b677-4608-8f0b-ad4f09a851f2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:07.424629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb6eef8a-b677-4608-8f0b-ad4f09a851f2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:07.425405 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb6eef8a-b677-4608-8f0b-ad4f09a851f2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:07.425840 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb6eef8a-b677-4608-8f0b-ad4f09a851f2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:07.563561 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bb6eef8a-b677-4608-8f0b-ad4f09a851f2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:07.571531 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bb6eef8a-b677-4608-8f0b-ad4f09a851f2 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1313 microversion: 2.1 time: 0.158644 Jun 04 18:45:07.572730 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 576/1139] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:07 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:08.590154 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f335f0e0-1f30-4dc8-92fb-dc8f50f29b0e tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:08.590850 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f335f0e0-1f30-4dc8-92fb-dc8f50f29b0e tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:08.599051 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f335f0e0-1f30-4dc8-92fb-dc8f50f29b0e tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:08.599566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f335f0e0-1f30-4dc8-92fb-dc8f50f29b0e tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:08.600467 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f335f0e0-1f30-4dc8-92fb-dc8f50f29b0e tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:08.600830 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f335f0e0-1f30-4dc8-92fb-dc8f50f29b0e tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:08.752295 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f335f0e0-1f30-4dc8-92fb-dc8f50f29b0e tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:08.760218 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f335f0e0-1f30-4dc8-92fb-dc8f50f29b0e tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1313 microversion: 2.1 time: 0.174884 Jun 04 18:45:08.760787 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 564/1140] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:08 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:09.781083 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a0d68f16-7069-4591-9488-6882a5062bc1 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:09.781932 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a0d68f16-7069-4591-9488-6882a5062bc1 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:09.792341 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0d68f16-7069-4591-9488-6882a5062bc1 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:09.793009 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0d68f16-7069-4591-9488-6882a5062bc1 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:09.794199 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0d68f16-7069-4591-9488-6882a5062bc1 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:09.794867 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0d68f16-7069-4591-9488-6882a5062bc1 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:09.931468 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a0d68f16-7069-4591-9488-6882a5062bc1 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:09.939519 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a0d68f16-7069-4591-9488-6882a5062bc1 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1313 microversion: 2.1 time: 0.165010 Jun 04 18:45:09.940099 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 577/1141] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:09 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:10.880539 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-b47f6b0b-f996-400b-9c3c-4e2ac26b203f req-17dca9e5-ff58-41ec-87f6-18924e33b80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edb7bb9-8ed7-484b-b75a-bbb036bb9650", "name": "network-vif-plugged", "status": "completed", "tag": "34dd65f9-8f77-4ec6-8451-7dd60049a50d"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:45:10.889954 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b47f6b0b-f996-400b-9c3c-4e2ac26b203f req-17dca9e5-ff58-41ec-87f6-18924e33b80b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:10.890416 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b47f6b0b-f996-400b-9c3c-4e2ac26b203f req-17dca9e5-ff58-41ec-87f6-18924e33b80b service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:10.902035 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-b47f6b0b-f996-400b-9c3c-4e2ac26b203f req-17dca9e5-ff58-41ec-87f6-18924e33b80b service nova] Creating event network-vif-plugged:34dd65f9-8f77-4ec6-8451-7dd60049a50d for instance 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 on hv-cinder-79053 Jun 04 18:45:10.907118 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-b47f6b0b-f996-400b-9c3c-4e2ac26b203f req-17dca9e5-ff58-41ec-87f6-18924e33b80b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030269 Jun 04 18:45:10.907712 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 565/1142] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:45:10.956857 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-57f58968-09e3-4a14-bda2-11013a49981c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:10.957396 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-57f58968-09e3-4a14-bda2-11013a49981c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:10.964474 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-57f58968-09e3-4a14-bda2-11013a49981c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:10.964955 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-57f58968-09e3-4a14-bda2-11013a49981c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:10.965738 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-57f58968-09e3-4a14-bda2-11013a49981c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:10.966210 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-57f58968-09e3-4a14-bda2-11013a49981c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:11.100214 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-57f58968-09e3-4a14-bda2-11013a49981c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:11.107775 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-57f58968-09e3-4a14-bda2-11013a49981c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1313 microversion: 2.1 time: 0.154845 Jun 04 18:45:11.108394 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 578/1143] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:10 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:12.129392 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5de20d33-0140-4e27-9c9b-cd7ab6c97350 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:12.130454 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5de20d33-0140-4e27-9c9b-cd7ab6c97350 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:12.140795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5de20d33-0140-4e27-9c9b-cd7ab6c97350 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:12.141483 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5de20d33-0140-4e27-9c9b-cd7ab6c97350 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:12.142659 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5de20d33-0140-4e27-9c9b-cd7ab6c97350 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:12.143326 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5de20d33-0140-4e27-9c9b-cd7ab6c97350 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:12.280529 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5de20d33-0140-4e27-9c9b-cd7ab6c97350 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:12.289184 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5de20d33-0140-4e27-9c9b-cd7ab6c97350 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1313 microversion: 2.1 time: 0.167281 Jun 04 18:45:12.289749 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 566/1144] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:12 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:13.310377 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6dc22c34-5bb2-4572-9eab-b3a7db290605 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:13.311203 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6dc22c34-5bb2-4572-9eab-b3a7db290605 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:13.314962 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:13.322666 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6dc22c34-5bb2-4572-9eab-b3a7db290605 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:13.323123 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6dc22c34-5bb2-4572-9eab-b3a7db290605 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:13.323882 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6dc22c34-5bb2-4572-9eab-b3a7db290605 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:13.324336 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6dc22c34-5bb2-4572-9eab-b3a7db290605 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:13.472347 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6dc22c34-5bb2-4572-9eab-b3a7db290605 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:13.480464 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6dc22c34-5bb2-4572-9eab-b3a7db290605 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1497 microversion: 2.1 time: 0.176601 Jun 04 18:45:13.481024 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 579/1145] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:13 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:13.919349 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b13b144d-d688-414c-bb21-a5c2d8c72f7c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:13.919904 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b13b144d-d688-414c-bb21-a5c2d8c72f7c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:13.921938 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:13.922815 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:13.933773 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b13b144d-d688-414c-bb21-a5c2d8c72f7c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:13.934230 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b13b144d-d688-414c-bb21-a5c2d8c72f7c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:13.935008 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b13b144d-d688-414c-bb21-a5c2d8c72f7c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:13.935444 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b13b144d-d688-414c-bb21-a5c2d8c72f7c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:13.962081 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b13b144d-d688-414c-bb21-a5c2d8c72f7c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:45:14.052843 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b13b144d-d688-414c-bb21-a5c2d8c72f7c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 204 len: 0 microversion: 2.1 time: 0.137034 Jun 04 18:45:14.053480 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 567/1146] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:45:13 2022] DELETE /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 18:45:14.061691 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a5d0376d-0072-4264-afd2-2bef9ad8296c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:14.062309 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a5d0376d-0072-4264-afd2-2bef9ad8296c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:14.068877 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5d0376d-0072-4264-afd2-2bef9ad8296c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:14.069331 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5d0376d-0072-4264-afd2-2bef9ad8296c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:14.070101 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5d0376d-0072-4264-afd2-2bef9ad8296c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:14.070542 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5d0376d-0072-4264-afd2-2bef9ad8296c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:14.202835 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a5d0376d-0072-4264-afd2-2bef9ad8296c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:14.211072 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a5d0376d-0072-4264-afd2-2bef9ad8296c tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1503 microversion: 2.1 time: 0.153310 Jun 04 18:45:14.211646 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 580/1147] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:14 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:15.230713 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1313bc7d-79a0-4085-94b1-de64ae37abe0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:15.231399 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1313bc7d-79a0-4085-94b1-de64ae37abe0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:15.238324 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1313bc7d-79a0-4085-94b1-de64ae37abe0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:15.238778 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1313bc7d-79a0-4085-94b1-de64ae37abe0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:15.239571 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1313bc7d-79a0-4085-94b1-de64ae37abe0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:15.240085 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1313bc7d-79a0-4085-94b1-de64ae37abe0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:15.665731 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1313bc7d-79a0-4085-94b1-de64ae37abe0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:15.673437 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1313bc7d-79a0-4085-94b1-de64ae37abe0 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1503 microversion: 2.1 time: 0.448283 Jun 04 18:45:15.674150 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 568/1148] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:15 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1503 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:16.346980 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-255b92dd-3e9b-4aff-abe0-769beec3b894 req-638d769f-c64e-4794-9251-35d860d063d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edb7bb9-8ed7-484b-b75a-bbb036bb9650", "name": "network-vif-deleted", "tag": "34dd65f9-8f77-4ec6-8451-7dd60049a50d"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:45:16.358857 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-255b92dd-3e9b-4aff-abe0-769beec3b894 req-638d769f-c64e-4794-9251-35d860d063d7 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:16.359111 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-255b92dd-3e9b-4aff-abe0-769beec3b894 req-638d769f-c64e-4794-9251-35d860d063d7 service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:16.360929 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0be040d5-d30f-4a1d-b567-49abed14b573 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:16.362283 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0be040d5-d30f-4a1d-b567-49abed14b573 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:16.369584 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0be040d5-d30f-4a1d-b567-49abed14b573 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:16.370399 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0be040d5-d30f-4a1d-b567-49abed14b573 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:16.371278 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0be040d5-d30f-4a1d-b567-49abed14b573 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:16.371721 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0be040d5-d30f-4a1d-b567-49abed14b573 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:16.372650 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-255b92dd-3e9b-4aff-abe0-769beec3b894 req-638d769f-c64e-4794-9251-35d860d063d7 service nova] Creating event network-vif-deleted:34dd65f9-8f77-4ec6-8451-7dd60049a50d for instance 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 on hv-cinder-79053 Jun 04 18:45:16.384237 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-255b92dd-3e9b-4aff-abe0-769beec3b894 req-638d769f-c64e-4794-9251-35d860d063d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042687 Jun 04 18:45:16.385735 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 581/1149] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 18:45:16.398524 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0be040d5-d30f-4a1d-b567-49abed14b573 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 18:45:16.493262 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0be040d5-d30f-4a1d-b567-49abed14b573 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 204 len: 0 microversion: 2.1 time: 0.136554 Jun 04 18:45:16.496093 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 569/1150] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 4 18:45:16 2022] DELETE /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 18:45:16.502755 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-879f58e3-276d-44df-a14d-5ec2637b36be tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:16.503612 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-879f58e3-276d-44df-a14d-5ec2637b36be tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:16.510220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-879f58e3-276d-44df-a14d-5ec2637b36be tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:16.510740 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-879f58e3-276d-44df-a14d-5ec2637b36be tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:16.511570 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-879f58e3-276d-44df-a14d-5ec2637b36be tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:16.512095 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-879f58e3-276d-44df-a14d-5ec2637b36be tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:16.648916 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-879f58e3-276d-44df-a14d-5ec2637b36be tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:16.656772 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-879f58e3-276d-44df-a14d-5ec2637b36be tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.158275 Jun 04 18:45:16.657538 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 582/1151] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:16 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 18:45:16.691498 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:16.692310 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:16.699049 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:16.699566 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:16.700441 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:16.700919 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:16.732799 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:16.733241 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:16.733682 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lazy-loading 'fault' on Instance uuid 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:45:16.779339 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfcdd0f3504778a4fc65dcf2471e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b343ebf1f80e474fa583574db40b1cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:16.787448 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0c63ebfa-b031-44aa-bd98-196468588c20 tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 200 len: 1303 microversion: 2.1 time: 0.100253 Jun 04 18:45:16.788110 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 570/1152] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:16 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:17.674913 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5cb1cfd7-2b03-465f-a523-1131ae3a2d99 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:17.675528 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5cb1cfd7-2b03-465f-a523-1131ae3a2d99 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:17.682514 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5cb1cfd7-2b03-465f-a523-1131ae3a2d99 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:17.682968 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5cb1cfd7-2b03-465f-a523-1131ae3a2d99 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:17.683818 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5cb1cfd7-2b03-465f-a523-1131ae3a2d99 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:17.684241 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5cb1cfd7-2b03-465f-a523-1131ae3a2d99 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:17.805172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:17.805729 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] [instance: 4edb7bb9-8ed7-484b-b75a-bbb036bb9650] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:17.812346 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:17.812803 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:17.813607 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:17.814045 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:17.825556 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5cb1cfd7-2b03-465f-a523-1131ae3a2d99 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:17.827817 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] HTTP exception thrown: Instance 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 could not be found. Jun 04 18:45:17.834016 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5cb1cfd7-2b03-465f-a523-1131ae3a2d99 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1565 microversion: 2.1 time: 0.162948 Jun 04 18:45:17.834822 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 583/1153] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:17 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Request method failure captured: Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 HTTP/1.1 Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6gd658D1Qodg2Z8n6iYUAOYv6H56hikF5XGMA3Z_OS4lK5Ub4zfPhKtAOxVLxWom7_FRG6Lk6shdRpK5tPOORgQmCOTtRsoM6mMSr2hhHigP5fIYSa2GkU_kQt1qMkSITf4Gav-jFeYirPXVaVfQKaCwBZ3tUP1i1jFlx0LsgK7pCs Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: b343ebf1f80e474fa583574db40b1cba Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesActionsTest-668050934 Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:45:17.841267 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b343ebf1f80e474fa583574db40b1cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b343ebf1f80e474fa583574db40b1cba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b343ebf1f80e474fa583574db40b1cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b343ebf1f80e474fa583574db40b1cba"}]}] Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesActionsTest-668050934 Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b343ebf1f80e474fa583574db40b1cba Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesActionsTest-668050934 Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesActionsTest-668050934-project Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 73bfcdd0f3504778a4fc65dcf2471e77 Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesActionsTest-668050934-project Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 could not be found. Jun 04 18:45:17.842784 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': '4edb7bb9-8ed7-484b-b75a-bbb036bb9650'} Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 could not be found. Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:45:17.843633 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 could not be found. Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 could not be found. Jun 04 18:45:17.845088 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:17.846542 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] Returning 404 to user: Instance 4edb7bb9-8ed7-484b-b75a-bbb036bb9650 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:45:17.846542 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e45bd967-bed8-4e2c-9152-ecd18d0974fb tempest-VolumesActionsTest-668050934 tempest-VolumesActionsTest-668050934-project] 10.222.0.39 "GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650" status: 404 len: 111 microversion: 2.1 time: 0.041780 Jun 04 18:45:17.846542 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 571/1154] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:17 2022] GET /compute/v2.1/servers/4edb7bb9-8ed7-484b-b75a-bbb036bb9650 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 18:45:18.401815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-c79a3805-5065-42b3-ab44-92daf95c15d2 req-42fdfb1a-8e66-483a-aaa7-bc929860279c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ab534c-de63-4e2e-84a4-ed1072d868d5", "tag": "35ec7e5f-d6aa-48ed-bcce-e38d546401a3"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:45:18.411904 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c79a3805-5065-42b3-ab44-92daf95c15d2 req-42fdfb1a-8e66-483a-aaa7-bc929860279c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:18.412379 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c79a3805-5065-42b3-ab44-92daf95c15d2 req-42fdfb1a-8e66-483a-aaa7-bc929860279c service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:18.424396 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-c79a3805-5065-42b3-ab44-92daf95c15d2 req-42fdfb1a-8e66-483a-aaa7-bc929860279c service nova] Creating event network-changed:35ec7e5f-d6aa-48ed-bcce-e38d546401a3 for instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 on hv-cinder-79053 Jun 04 18:45:18.430268 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-c79a3805-5065-42b3-ab44-92daf95c15d2 req-42fdfb1a-8e66-483a-aaa7-bc929860279c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034051 Jun 04 18:45:18.431037 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 584/1155] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:45:18.852129 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b544e57f-1792-440b-ae41-e01b38a2e83a tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:18.852746 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b544e57f-1792-440b-ae41-e01b38a2e83a tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:18.859007 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b544e57f-1792-440b-ae41-e01b38a2e83a tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:18.859462 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b544e57f-1792-440b-ae41-e01b38a2e83a tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:18.860263 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b544e57f-1792-440b-ae41-e01b38a2e83a tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:18.860702 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b544e57f-1792-440b-ae41-e01b38a2e83a tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:18.924604 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b544e57f-1792-440b-ae41-e01b38a2e83a tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:18.933006 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b544e57f-1792-440b-ae41-e01b38a2e83a tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1217 microversion: 2.1 time: 0.085391 Jun 04 18:45:18.933524 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 572/1156] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:18 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:19.956389 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-db6966bf-2958-4368-a31c-ecb552e0160d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:19.957068 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-db6966bf-2958-4368-a31c-ecb552e0160d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:19.967432 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-db6966bf-2958-4368-a31c-ecb552e0160d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:19.968064 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-db6966bf-2958-4368-a31c-ecb552e0160d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:19.969220 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-db6966bf-2958-4368-a31c-ecb552e0160d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:19.969805 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-db6966bf-2958-4368-a31c-ecb552e0160d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:20.045680 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-db6966bf-2958-4368-a31c-ecb552e0160d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:20.053815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-db6966bf-2958-4368-a31c-ecb552e0160d tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1380 microversion: 2.1 time: 0.105447 Jun 04 18:45:20.054375 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 585/1157] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:19 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1380 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:20.472957 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-54bfebab-682f-422b-87cd-50aa7b4b402a req-db670e39-c390-4d70-bbef-01d16e7f9b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ab534c-de63-4e2e-84a4-ed1072d868d5", "name": "network-vif-deleted", "tag": "35ec7e5f-d6aa-48ed-bcce-e38d546401a3"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 18:45:20.482863 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-54bfebab-682f-422b-87cd-50aa7b4b402a req-db670e39-c390-4d70-bbef-01d16e7f9b7d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:20.483312 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-54bfebab-682f-422b-87cd-50aa7b4b402a req-db670e39-c390-4d70-bbef-01d16e7f9b7d service nova] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:20.494724 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-54bfebab-682f-422b-87cd-50aa7b4b402a req-db670e39-c390-4d70-bbef-01d16e7f9b7d service nova] Creating event network-vif-deleted:35ec7e5f-d6aa-48ed-bcce-e38d546401a3 for instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 on hv-cinder-79053 Jun 04 18:45:20.499716 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-54bfebab-682f-422b-87cd-50aa7b4b402a req-db670e39-c390-4d70-bbef-01d16e7f9b7d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033106 Jun 04 18:45:20.500409 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 573/1158] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 4 18:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 18:45:21.076417 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5b77fd26-b8e2-4202-a276-0a972ea5587e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:21.077467 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5b77fd26-b8e2-4202-a276-0a972ea5587e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:21.087130 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b77fd26-b8e2-4202-a276-0a972ea5587e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:21.087572 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b77fd26-b8e2-4202-a276-0a972ea5587e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:21.088364 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b77fd26-b8e2-4202-a276-0a972ea5587e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:21.088787 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b77fd26-b8e2-4202-a276-0a972ea5587e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:21.159736 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5b77fd26-b8e2-4202-a276-0a972ea5587e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:21.171382 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5b77fd26-b8e2-4202-a276-0a972ea5587e tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1380 microversion: 2.1 time: 0.101220 Jun 04 18:45:21.172272 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 586/1159] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:21 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1380 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:22.194947 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1df3077d-c4ce-4dda-9345-471152b0df17 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:22.195732 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1df3077d-c4ce-4dda-9345-471152b0df17 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:22.203650 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1df3077d-c4ce-4dda-9345-471152b0df17 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:22.204588 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1df3077d-c4ce-4dda-9345-471152b0df17 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:22.205116 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1df3077d-c4ce-4dda-9345-471152b0df17 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:22.205629 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1df3077d-c4ce-4dda-9345-471152b0df17 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:22.290900 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1df3077d-c4ce-4dda-9345-471152b0df17 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:22.299336 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1df3077d-c4ce-4dda-9345-471152b0df17 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1380 microversion: 2.1 time: 0.111987 Jun 04 18:45:22.300048 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 574/1160] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:22 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1380 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:23.320668 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:23.321285 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:23.330941 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:23.331458 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:23.332633 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:23.333203 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:23.364664 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:23.365107 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:23.365545 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lazy-loading 'fault' on Instance uuid e2ab534c-de63-4e2e-84a4-ed1072d868d5 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 18:45:23.410815 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308d60778a0e489491cd6b3a79c96385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1701547610945ceac41e94e733f61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 18:45:23.418589 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b9db39c6-bbc9-4edc-8eef-b46261021926 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 200 len: 1222 microversion: 2.1 time: 0.104005 Jun 04 18:45:23.419151 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 587/1161] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:23 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 18:45:24.436172 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:24.436955 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] [instance: e2ab534c-de63-4e2e-84a4-ed1072d868d5] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 18:45:24.443754 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:24.444343 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:24.445715 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 18:45:24.446510 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Lock "06ed45c9-c444-4a55-b87d-b6450438916e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 18:45:24.461434 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] HTTP exception thrown: Instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 could not be found. Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Request method failure captured: Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 HTTP/1.1 Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept: application/json Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Connection: close Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Length: 0 Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Content-Type: application/json Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Host: 10.222.0.39 Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABim6bQtZMF_bOD5lPHdO25PtjCWTAK55uuSJCNcLgDTsXMyoaCKPj2fnoNK-6T71RbK1Qa-kRY2WfIzQvqT9o6guWptAmY5dUyHGt9eXnWxp5_8e7o-SW6wnlHXzADs3_AfqCjXJC4Vy354TMOUB-ZE_EzaGSVuDmx0CT6qFrYtONeynE Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Id: None Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Domain-Name: None Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Id: b1701547610945ceac41e94e733f61a1 Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-TestShelveInstance-795493806 Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Role: reader,member Jun 04 18:45:24.463333 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Roles: reader,member Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1701547610945ceac41e94e733f61a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b1701547610945ceac41e94e733f61a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b1701547610945ceac41e94e733f61a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1701547610945ceac41e94e733f61a1"}]}] Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-TestShelveInstance-795493806 Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b1701547610945ceac41e94e733f61a1 Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-TestShelveInstance-795493806 Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User: tempest-TestShelveInstance-795493806-project Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Id: 308d60778a0e489491cd6b3a79c96385 Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-TestShelveInstance-795493806-project Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: method: > Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: exception: Instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 could not be found. Jun 04 18:45:24.465133 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: action_args: {'id': 'e2ab534c-de63-4e2e-84a4-ed1072d868d5'} Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 could not be found. Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 18:45:24.469592 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 could not be found. Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 could not be found. Jun 04 18:45:24.473159 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Jun 04 18:45:24.475341 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Returning 404 to user: Instance e2ab534c-de63-4e2e-84a4-ed1072d868d5 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 18:45:24.475341 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ebb01c7c-90ea-4d9a-9602-3c8d5e6c4ea8 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5" status: 404 len: 111 microversion: 2.1 time: 0.032569 Jun 04 18:45:24.475341 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 575/1162] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 4 18:45:24 2022] GET /compute/v2.1/servers/e2ab534c-de63-4e2e-84a4-ed1072d868d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 18:45:24.646804 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9d986f5f-262f-4a6b-9a31-996064986019 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] Calling method '.version_select at 0x7f467de01160>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 18:45:24.683909 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9d986f5f-262f-4a6b-9a31-996064986019 tempest-TestShelveInstance-795493806 tempest-TestShelveInstance-795493806-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-5573208" status: 202 len: 0 microversion: 2.1 time: 0.041473 Jun 04 18:45:24.684519 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 588/1163] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 4 18:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-5573208 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 18:45:38.873685 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:45:38.874341 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Sat Jun 4 18:45:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 18:45:43.232122 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:45:43.232671 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Sat Jun 4 18:45:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 18:47:12.049710 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:47:12.050370 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Sat Jun 4 18:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 18:48:58.883464 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:48:58.884660 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Sat Jun 4 18:48:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 18:49:03.243341 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:49:03.244365 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Sat Jun 4 18:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 18:50:32.059795 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:50:32.060937 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Sat Jun 4 18:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 18:50:54.078065 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:50:54.078999 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Sat Jun 4 18:50:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 18:50:54.133629 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:50:54.133812 dv-cinder-790535-41-iscsi devstack@n-api.service[117732]: Sat Jun 4 18:50:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 18:51:00.068285 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 18:51:00.069242 dv-cinder-790535-41-iscsi devstack@n-api.service[117731]: Sat Jun 4 18:51:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!